Nah, I have the same experience as the GP, and in every HN thread about email self-hosting, there are a number of comments along the lines of “I’ve been self-hosting my email for 10-20 years and never had any problems”. My SME employer also self-hosts without issues.

Experiences obviously differ, but it’s unclear where the differences stem from, apart from long-term IP reputation.