That's because the political compass is two-dimensional, but everyone insists on thinking of it as a one-dimensional thing.

You've got left wing and then you've got right wing, and then in the vertical direction you've got authoritarianism and libertarianism. When people say far right and far left what they really mean is that the extreme edges horizontally and right at the top vertically. Think Castro, and not Gandhi. Both were left wing but are nowhere near each other in political phasespace