I’m not a physical therapist, but every time I’ve worked with one my issues have been due to some sort of imbalance in strength or flexibility, and less about not just using my body right. There are a load of exercises that address over pronation online, but I can’t speak to how well they work because I don’t have this issue myself.

If you google pronation exercises a ton come up.

Even runner’s world has an article with exercises here

Personally for me, when my calves get tight I tend to over-pronate. It's not really about being aware of it when walking/running, it's just that my ankle doesn't have enough flexibilty so my body finds that flexibilty by collapsing the ankle inwards instead. But it can be caused by weakness as well, in the ankle and/or the hips. If you're concerned, it's worth seeing a physical therapist who should be able to help you figure out what causes the over-pronation for you personally.