That kinda goes back to what I said about you also needing to factor in how well you and the other people can separate the two environments. If that is a personal limitation, then it's best to understand it and manage it as you suggest.

Personally I have no issue keeping work at work and home at home. There have been many times where my coworkers and I have had a tense week at work, full of disagreement and debates, only to hang out like bros on the weekend. There's one coworkers who can't make that separation, and that's fine. They've realized it and I'll respect that boundary.