We should be able to build them cheaper and faster, not slower and more expensive. And there are countries in the world, that can get it done cheaper, so why can't we?

It's because we stopped building them. We have academic knowledge on how to do it but not the practical/technical know-how. A few countries do it because they're doing a ton of reactors, but those don't come cheap either.