There is Qobuz (edit they do streaming and purchase). I used to purchase a lot of music on iTunes too, back when they went DRM-free but I went back to... physical media.

not deal with physical media (I’m not a collector, and I want to avoid plastic waste)

This probably not the ideal solution you are looking for, but you can purchase the disc, rip it and then donate it to someone else.

Bandcamp is where I try to grab most of my music.

For me, I mainly use Bandcamp, 7digital & Qobuz for Western music. Sometimes the artists sell directly from their own sites though; for e.g. I bought Willow's empathogen album directly from her website.

For Japanese music, I use Ototoy. They accept foreign cards, but for some releases they won't let you add it to the cart unless you use a VPN set to Japan.

For less available stuff, I sometimes buy second hand CDs from Discogs / eBay / Music Magpie / similar sites, rip and then resell the CD if I don't wish to keep it.

For new CDs that I do want to keep, I buy from wherever the artist is selling. CDJapan for Japanese stuff.

Coming in to back up Qobuz. Between qobuz and bandcamp i have been able to find 100% of the music i want to own and i feel good about it

Audials (Romania, Germany) e.g. "Audials Play" offers legal recording of internet radio stations by capturing unencrypted audio streams for personal, non-commercial use, effectively acting as a digital recorder. It enables users to listen to and record thousands of stations, automatically splitting tracks, adding ID3 tags, and according to law, does not bypass copy protection.

7digital, UK/German Company and they even sell FLACS with up to 24bit. And their support is amazing. Had an album missing a song and they got me another album for the same price as a replacement. The one missing a song is still in my library so basically buy one get one free. Mayor downside you can only download an album 3 times before you have to contact support to reset it.