I always assumed the immobile object was made of an impenetrable substance. Force is also always fundamentally an interaction between particles.

That's not to say there is no change to the system. What builds up is energy. Depending on the two particles in the system and the vectors involved, quantum tunneling is possible and the particle exerting the force passes into the object. Then the system changes.