people are going to be hesitant to move somewhere else

It is however much easier to move between fediverse instances than it is to move from commercial social media to the fediverse. Once you're on the fediverse, moving is easier.