Ableist could be another potential framing, but there's no need to throw such terms around unwarranted.

For example, an autistic person might reasonably conclude that OP was being passive aggressive if they disclosed that they weren't consensually engaging all that time. Indirect communication is confusing for some people, whether they are on the autism spectrum or not.