That’s on you. Why would this be any different in user behavior? It’s just a difference in underlying tech architecture
Socially it sounds like you want to be an asshole user but don't want to put in the effort to be an asshole mod or an asshole server admin. Of course you running into assholes constantly is also very likely a personality flaw on you rather than others
I at least have a core group of friends that use Signal and I keep Element installed on my phone and computers hoping someday more people move to that over the next decade