I developed my philosophy in college, after having a roommate for a semester who watched EVERY SHOWING of ESPN Sportcenter - a show that's on about 8 times a day with at least two showings after midnight. He also got in at least two fistfights over NASCAR racing. It wasn't pleasant.
Basically, I believe the only reason most people watch sports is to see someone get hurt/killed. Or to see cheerleaders or other female sports accoutrements (I'll admit my most enjoyable sports experience involves Wrigley field on a hot summer day, some bleachers, and enthusiastic young, female Cubs fans).
What it ultimately boils down to is that what we'd like to see is a couple of guys in a sandy pit with some pointy metal objects to beat each other with. But since we can't have that we make do with Football (whatever sport that is in your country) and Boxing, both of which satisfy a small element of the urge without consumating what we're really looking for.
None of this explains golf. My theory accounts for this as follows: Golf is not a sport. At all. Least of all a spectator sport. Add some Viet Cong in the rough and we're talking business, but as it is, golf is nothing but a waste of real estate and Sunday afternoon network television.