Non binary covers a range of identities. Some feel like neither man nor woman is a good fit for them, or that they don't really identify with the concept of gender at all. Others partially identify with one or both of the "binary" genders. It can be difficult to understand a feeling, sensation, or identity which you have no basis for understanding or if as you say there is something stopping you from properly considering it.

Like others I would recommend experimenting with your identity to see if there's something that feels comfortable to you. Perhaps there are LGBTQ+ spaces you could safely join where you live? Or perhaps there are online spaces like this one you could hang out in? Reading and talking about identities can be very helpful. Check out the links in the sidebar as well if you haven't already, especially the gender dysphoria bible.

Do you feel comfortable with people thinking of you as a man? Does it feel nice when people don't gender you?

I feel like the only way you're going to get some answers is through experimentation. Try out different pronouns, do they feel weird? If they do, why?

I knew I was trans because of my body dysphoria and because I "wanted" to be a girl, but I'd never felt like I was a girl. But I feel like that stemmed of a deep self-hatred, some transphobia and thinking I'd never be "good enough" to be a woman. After many years repressing it, I wanted to try though. And turns out it was the correct choice for me! It took me years to feel comfortable presenting feminine, but for me the discomfort of experimentation was better than "being a man".

So yeah, some people figure it out immediately, for others like me it takes years, but the only way to know for sure is being true to yourself and trying things out without caring what other people will say.

Edit: oh, and yes, non-binary people fit within the trans label, although some of them prefer not to use it.

I struggled to feel like a woman too. Part of it was internalized transphobia, but part of it was imagining what others would expect of me when I called myself a woman. I don't want to be ultra fem and all the other expectations, and telling myself that helped a lot. My gender expression is quite masculine, but I'm still a woman (or demigirl maybe? Eh, whatever).