I never did P90X, but don't get down if you're really sore tomorrow. It will get better. It's not the worst thing in the world to take a break before really getting going with the program if need be.
He did Insanity, I believe. And yes, I was DYING during the fit test too. Stick with it, it gets much better.