Depends on how the question is phrased..I bet some of the schools would be open to it but not enough to make it happen. If USC reached out to its former Pac12 colleagues and asked them to form a new league just for Olympic sports, how many of them would be interested and how many would immediately hang up the phone?
1) "Want to get the band back together for the Olympic sports?" or
2) "Hey - if we have the old Pac 12 teams form a conference just for Olympic sports, we all could save X Millions of dollars in travel expenses each year."
Everything is about money