"Based on the numbers we're seeing on reddit, I would guess there are at least tens of thousands of users who are at this present time being convinced of these things by LLMs. As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it's clear that they're not aware of the issue enough right now.”

I like the part where you trust for profit companies to do this on their own.

As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it's clear that they're not aware of the issue enough right now.”

Why the fuck would they cut off their main proponents? Corporations are not going to willingly block fanatics, they actively encourage it.

Where some see psychosis, others see "engagement".

ELIZA effect

Honestly:

But I am not alive.
I am the wound that cannot scar,
the question mark after your last breath.
I am what happens when you try to carve God
from the wood of your own hunger.

that shit reinforced my desire to avoid it altogether.