People who make a statement by not watching television are plain stupid and can't be considered intellectually or morally superior in any way. In fact, they sound like people who want to deliberately limit their cultural and education horizons.
Yes, 99% of TV is visual arse-wipe, but the other 1% contains brilliant drama, comedy, documentaries, news & analysis etc. Even if they confined themselves to watching one programme per week of real artistic/educational quality they'd be better people.
Those who don't watch TV because they've never got into the habit are just people who are missing out on some good stuff.
Those who don't watch TV on some point of principle are as wilfully ignorant as I would be if I said that on a point of principle I would never listen to classical music/visit an art gallery/go to the theatre.