What's the minimum level of fame needed to avoid being cancelled?

What's the minimum level of fame needed to avoid being publicly shamed? I mean, lately I see a lot of artists doing questionable or downright bad/illegal things, and yet they still have a horde of fans defending them tooth and nail. So it makes me wonder, how many fans do you really need to have that level of security? To know you have a fanbase that will always be there no matter what? Maybe 10 fans aren't enough, or even 500... what's the minimum?