As has been stated, the big bucks don't get that way by being dumb. I was always raised to be selective. The big groups that go through a woods with the 'brown is down' mentality sickens me. I have a friend in one of these groups that stumbled into a trophy by accident, rather than put in the work and try to understand how the big boys think and move. The biggest issue I have is with those that shoot small bucks and then justify it as being 'for the meat', if the meat is your only concern, go shoot a doe.
When done right, it's a rewarding experience whether you get a shot off or not. Sadly there are far too many idiots that give everyone a bad reputation. I can understand how it's not for everyone, but most good hunters understand and respect their prey more than the conscientious objectors that want to save Bambi.