Exactly, it might take us some minor adjusting (sometimes even because of our disability, like for example with poor memory or a learning disability that makes it hard to adjust to new patterns), but if it makes people around us feel safer and more included (E: excluding bigots, always excluding bigots, with accordance to the tolerance paradox/social contract!), it's 100% worth it, without any question.

People who consciously refuse to take such minor consideration of those around them are just broadcasting their intolerance.