It will be a factor for both teams. Cold weather is overrated in college football imo. If we were playing the game in February, after the team is used to the cold it would be our advantage. But, with the fall we've had, it will effect both teams the same as neither is used to it.
I've been to 50 degree games at JTS with some wind in October and was bundled up like I was in the arctic. Put the same day in early March and I'd have been in shorts because I had adapted to the cold.
It just hasn't been cold enough yet this fall for anyone to adjust to rose temps.