I don't think that means it should happen, but when all you hear is your team is a final four contender, and you're ranked top 10 all season - naturally as fans you adjust your expectations accordingly.
So, when we fall well short of those expectations...it's easy to start seeing holes in the plan. I think TJ will still put together a good team next year, and likely finish in a similar spot in conference. I also think it's fair to want to see some continued growth. Which at least for me, is where the questions are coming from with this current portal class.
Elite 8 as the floor would be crazy to expect given the program history. Elite 8 as a ceiling is a good place to start though. Sweet 16 should be the goal each season imo, then we all know anything can happen from there.