If they're not making fun of cargo shorts it'll be something else they're mocking. Wear what you want. I get the appeal of cargo shorts for carrying stuff. And I'll usually wear them when I golf because I like the extra pockets for carrying golf balls and tees, etc.
where are you golfing that you can wear cargo shorts? Most golf courses don't allow them.

