Yup, the AI models are currently pretty dumb. We knew that when it told people to put glue on pizza.

That's dumb, sure, but on a different way. It doesn't show lack of reasoning; it shows incorrect information being fed into the model.

If you think this is proof against consciousness

Not really. I phrased it poorly but I'm using this example to show that the other example is not just a case of "preventing lawsuits" - LLMs suck at basic logic, period.

does that mean if a human gets that same question wrong they aren’t conscious?

That is not what I'm saying. Even humans with learning impairment get logic matters (like "A is B, thus B is A") considerably better than those models do, provided that they're phrased in a suitable way. That one might be a bit more advanced, but if I told you "trees are living beings. Some living beings can bite. So some trees can bite.", you would definitively feel like something is "off".

And when it comes to human beings, there's another complicating factor: cooperativeness. Sometimes we get shit wrong simply because we can't be arsed, this says nothing about our abilities. This factor doesn't exist when dealing with LLMs though.

Just pointing out a deeply flawed argument.

The argument itself is not flawed, just phrased poorly.

Sorry for the double reply.

What I did in the top comment is called "proof by contradiction", given the fact that LLMs are not physical entities. But for physical entities, however, there's an easier way to show consciousness: the mirror test. It shows that a being knows that it exists. Humans and a few other animals pass the mirror test, showing that they are indeed conscious.