There is a middle ground between pulling up the ladder and trying to get everyone in the world on board.
Everyone who is genuinely interested is more than welcome but the fediverse is currently not equipped to handle hundreds of thousands or even millions of new users. Let the general public find their own niche and concentrate on the ones who find us on their own or through friends.
Apparently people who hope that social media bans will drive a significant amount of people to the fediverse. This is how this whole thread started. To which I replied that I don't want the fediverse to grow too rapidly. I would be very happy with slow but steady growth.