Yet another reminder that LLM is not "intelligence" for any common definition of the term. The thing just scraped responses of other LLM and parroted it as its own response, even though it was completely irrelevant for itself. All with an answer that sounds like it knows what it's talking about, copying the simulated "personal implication" of the source.

In this case, sure, who cares? But the problem is something that is sold by its designers to be an expert of sort is in reality prone to making shit up or using bad sources, while using a very good language simulation that sounds convincing enough.

the ideological composition that:

if you are allowed to do something then I must be allowed to

coupled with

just because i can do something doesn't mean that you can do it

... is the basis for all human chauvinism be it gender, racial, or national. And now these fictions .. these quasi-legal fictions called corporations ... are taking the rights of human beings as their own and laying claim to them while simultaneously declaring that humans don't have these rights which eminent directly from being human.

What the fuck is going on ?

What if they are using OpenAI API and they dont have a model of their own?

Elon be like: "What if I got OpenAI's chatbot and disguised it as mine?"

The irony of calling it Grok.

Just scambots eating scams scammed by other scammers, all the way down.

AI is looking like the biggest bubble in tech history and stuff like this really ain't helping.

Mistral Dolphin 2.1 said the same to me once. They use GPT-4 for the reinforcement so they don't have to pay humans, and that sentence must slip in there more than they bother to check.

I can buy that this was accidental because that answer is way less direct/relevant that what ChatGPT would provide. The guy asked for malicious code and Grok described how to not get malicious code.

And then he asks if there's a policy preventing Grok from doing that, and Grok answers with a policy that prevents ChatGPT from providing malicious code. Seems pretty consistently wrong.