They may not be in the Premier League, they may not have a great chance of winning every game they play, but I've never doubted myself (for more than a week) for being a fan of West Ham.
There will come a time when you ask yourself is it really worth the effort you put into following and even finding a stream to watch whatever team you choose. If you're going to follow a team like Arsenal or Chelsea or Barca because they win a lot, the passion may dwindle when they go through a slump or when college football starts back up and it's easier to turn on a tv to watch the longhorns than it is to miss the first 20 minutes of the game trying to find a stream in English.
The reward a fan receives from following a team is not directly proportional to their position in the league at the end of the season. It's neither proportional to the weekly wages of their highest paid player nor to the number of international games they play. The reward you get from following a team is proportional to the pride you feel when asked what team you follow and why. I love West Ham just like I love my first car: not because it is the best, but because it was the first that I could call my own. They got me to love and appreciate a game I never though I would enjoy. I was still frustrated when Avram Grant looked like he was going to soil himself during every match, it still bothers me that Carlton Cole is still on our team, but there isn't a gameday during the season where I'm not wearing my claret and blue.