We went to E$PNzone late Sunday night for dinner after all the games were over and the crowds had left. Problem was, the crowds had already eaten all their steak and chicken, so all they had left were like 5 menu items. What little food they had was ok, but way way overpriced. I definitely can't imagine waiting in line to cram in there on a Sunday afternoon, and honestly can't see myself ever going there again.
In my opinion, most sports books are not good places to just go "sit and watch" a game. There is a pretty good mexican place/cantina at NYNY that has really good food and plenty of tv's tuned to sports, I've spent a couple Saturday afternoons there watching college games. It's right next to E$PNZone.