Hmm, humans swing their arms while running to counteract angular movement. Presumably, the horse undercarriage wouldn't have this problem, because there's more legs in an offset motion and just some distance between the pairs of legs to hold the body straight.

But horses nod their heads during gallop, so maybe the centaurs would do a little chug-chug motion with their arms instead.