For reference, I like most of the series by KD Robertson. The harem doesn't need to develop right away, but it shouldn't take forever (like I would consider that the harem in wheel of time develops too slowly).