What to do is long hold on the username of the person you want to reply to (or anywhere on that horizontal area) - a vote/reply/etc bar should appear below.
Oddly enough, the opposite is true when viewing comments in a thread - the bar is visible be default but can be hidden with a long hold!