Illusion of intelligence through mimicking human language patterns is enough to fool most people, unfortunately. I am sure that I would get fooled too, but I don't use LLMs because I understand that there is no intelligence/expertise behind the replies.

The problem is marketing. LLMs have been around for ages.

AI implies it's intelligent when it's not.

Deus Ex predicted this.

Morpheus, the 'prototype of a much larger system', canonically created around 2027:

"God and the gods were apparitions of observation, judgment and punishment. Other sentiments towards them were secondary."

"The human organism always worships. First it was the gods, then it was fame (the observation and judgment of others), next it will be the self-aware systems you have built to realize truly omnipresent observation and judgment."

"The need to be observed and understood was once satisfied by God. Now we can implement the same functionality with data-mining algorithms."

"You will soon have your God, and you will make it with your own hands."

We are also largely on track for the NSF uprising, civil war, balkanization into corporate city states... and the right wing conspiracy of the 90s, FEMA death camps?

Well, more like ICE, but uh, FEMA funds are currently being rerouted toward concentration camps, and FEMA employees have also recently been reassigned to ICE.

The militia types from the 80s and 90s, Alex Jones... well, they willed their own nightmare into existance... extremely ironic.

I will never understand how people will believe shit this easily from ai, it’s an over glorified middle prediction key when it comes to text, knows less than nothing

I understand it, but I'm also informed enough not to fall for it.

For 100 years we've had fictional stories about thinking machines. With the explosive advancement of computing technology in the 80s and early 2000s, seemingly magical things have been brought to life with computing solutions and technology. Our popular fiction has advanced slightly ahead of realty. We've had the modern version of an AI boogyman since 1984 with the HAL9000.

Pop culture today is telling people that ChatGPT and other GenAI LLMs are the thinking machines from fiction. So those folks assume they are. Clarke famously said "Any sufficiently advanced technology is indistinguishable from magic." For so many that aren't involved with IT/technology professionally they think its magic. Those of us with more knowledge understand that Gen AI LLMs are just really fancy word predictors that tell us versions of things other have said before. They don't think. They don't reason. They certainly aren't inherently trustworthy with what they output.

For thousands of years, we’ve looked at the apparent effort behind a communication as a decent proxy for its trustworthiness (as well as other things like signals for social status and interpersonal respect).

We’re hacking very fundamental aspects of what was basically our first and most important invention. I think it’s a big mistake to blame user error.

We’re not rational automatons. That’s just a fiction that the wealthy use to accumulate power. “A rational person wouldn’t get exploited by us, therefore our exploitation is beyond reproach.”

I suspect people like this will just kinda believe anything if it's flattering enough.