Interesting question! For me it feels like both a social group and age-based thing. I know of a couple co-workers in their upper 30s / mid 40s who play video games and we’ll chat about games very occasionally. My ex’s friends were all mid-twenties folks and gaming was one of their multiple hobbies.
But in general, I wouldn’t bring video games up with the majority of my other co-workers, and certainly not during small talk with more-or-less strangers (chiropractor, barbers, etc), whereas every other hobby I’d be cool talking to strangers about. I think I’ve been socialized to feel like gaming is “immature” and only to be talked about with other people “in the know” so I don’t feel judged for enjoying it.