I had the same issue in the late game of Blue Prince.

The RNG is pretty fun at first but it quickly becomes frustrating when you have specific layouts in your mind. You gain some control but not enough to make it fun to restart over and over again until you don't get shafted.

My solution was simple: I cheated. I gave myself infinite dice and rerolled the rooms until I got the layout I was looking for. Much more enjoyable that way.