I do get tired of it. However, when you have calls that do literally change or dictate the outcome of the games, as we had last year in both Kansas MBB games (and some would argue the last one too) and the Texas football game, you can't really blame fans for looking more closely at what the officials do.
I think the play of the team factors in as much as the officials, but when they do make an obviously incorrect call that changes the outcome......the officials deserve every bit or criticism and attention they get.
As far as just calling fouls, traveling, 3 seconds, whatever.......I don't think it is much of a factor as long as they are consistent with both teams, and they are consistent with what criteria they use to make the calls. When it gets too lopsided one way or the other, or inconsistent......then there is a problem.