Your conflating the legal system with greater society. He's not in jail or paying a settlement because there wasn't enough evidence to convict him in court. The rest of society is not bound by these same restrictions and are free to pass judgment as they please.

I wouldn't say accusations are tantamount to fact, but when you get dozens of people making the same accusation, about a crime that's difficult to prosecute and convict because of the nature of the crime, it's hard to give him the benefit of the doubt.

Are you not also passing judgement on the accusers here? You're essentially calling them all liars who are guilty of making false reports. Both sides can't be "innocent" here.