This is entirely dependent on the relationship, isn't it?
* Friend/family - no, not rude to call unscheduled. Can be a nice surprise.
* Workplace (external/customer) - Yes, absolutely rude (but sometimes necessary, unfortunately)
* Workplace (internal) - Kind of rude, but IM/Teams has made...