Sorry, I tried using MacPorts in a VM and installing Nautilus with sudo port install Nautilus as suggested on the MacPorts website, but this was the final result after like 20 minutes of "installing" data and the like to no avail.

(This was tested on a macOS Sequoia VM with an M4 MBA host running macOS Tahoe Beta 4. It is possible this may work better on an x86 Mac or older macOS version, but I wouldn't get too caught up in this.)

There is ONE other way to run Nautilus on macOS that I've used a bit, but it's kind of cheating and not that great: Containers. Specifically, Docker and similar programs should allow this (which I did test once), but more recently Apple introduced their own Containerization framework which I also tested and was able to get up and running. The issue is that Xquartz, which you'd have to use to get any GUI Linux applications on macOS, isn't very good in and of itself. No Retina support is the biggest dealbreaker for me, but this is also technically just running a micro Linux VM with access to your macOS files a bit like Windows Subsystem for Linux.