You are correct. Buddhism is indeed more akin to a philosophy to find meaning in life and to act in a way that minimizes suffering to yourself and others through compassion.

Although there is a lot of mythology regarding reincarnation and energies, but the old nature of Buddhism makes it so not everything is clear crystal whether it was stated by Buddha or not. Moreover, like Hinduism, a lot of things explained by the Buddha were metaphors that explain processes that are hard to explain unless you have a clear understanding of science that didn't exist back when Buddhism was founded, or were analogies to better explain them. Stuff like the cosmic wheel, energies, that sort of thing.

Additionally, many myths were created around the image of Buddha that were embellishments added at a later date, not just to the teachings, but to the man himself. You could say that if some Buddhist believes in something that it is part of Buddhism, but Buddhism is a personal journey that each person must take themselves and see. The Buddha always said that each one of us must take that journey and learn the things he learned himself. He is no prophet, nor god, but a man who understood part of the rules of the universe and that each person could too. This is why Buddhist teachings take the form of koans. Small, confusing tales meant to make you think deeply upon certain characteristics of the universe, to help you reach the same conclusions as he did by yourself. "If two hands make a clapping sound, what is the sound of one hand ?" This is one such koan, what does it teach you about life, society and the universe? It's not quick and easy. You're supposed to sit and think about it. Even if i tell you what i think it means, you'll only understand my perspective on it based on my life experiences. Your lesson might take a different explanation than mine based on your own life, which is why koans have no universal solution. They're meant to replicate thought patterns and realizations that are bespoke to each intelligent being. No one can spoonfeed you Buddhism. It requires agency, thought and doubt.

This is why the Dalai Lama said that if science proves Buddhism wrong, Buddhism adopts the scientific explanations. Buddha was a man that came across some fundamental insights into being happy. Sooner or later these insights will be discovered and proven by science, much like the benefits of meditation were, and will be explained in scientific terms. Meditation helps you focus and being at peace because it reduces the activity in the Default Mode Network of the brain. Buddha could not explain the default mode network. He probably didn't know what those words even meant. But he knew that "Meditation brings wisdom. Lack of meditation leaves ignorance. Know well that leads you forward and what holds you back."

I can understand the weariness of some people about religion. I can understand the distrust about Buddhism. Yet i can appreciate that everyone has their own internal journey and doubting Buddhism is an integral part of it. I too began by thinking Buddhism made no sense, until it did. Because of this exact reason, there are no heretics in Buddhism.