this is because an LLM is not made for playing chess

Tbf, the article should probably mention the fact that machine learning programs designed to play chess blow everything else out of the water.

An LLM is a poor computational/predictive paradigm for playing chess.

ChatGPT has been, hands down, the worst AI coding assistant I've ever used.

It regularly suggests code that doesn't compile or isn't even for the language.

It generally suggests AC of code that is just a copy of the lines I just wrote.

Sometimes it likes to suggest setting the same property like 5 times.

It is absolute garbage and I do not recommend it to anyone.

Sometimes it seems like most of these AI articles are written by AIs with bad prompts.

Human journalists would hopefully do a little research. A quick search would reveal that researches have been publishing about this for over a year so there's no need to sensationalize it. Perhaps the human journalist could have spent a little time talking about why LLMs are bad at chess and how researchers are approaching the problem.

LLMs on the other hand, are very good at producing clickbait articles with low information content.

I swear every single article critical of current LLMs is like, "The square got BLASTED by the triangle shape when it completely FAILED to go through the triangle shaped hole."

I suppose it's an interesting experiment, but it's not that surprising that a word prediction machine can't play chess.

LLM are not built for logic.

A strange game. How about a nice game of Global Thermonuclear War?

The Atari chess program can play chess better than the Boeing 747 too. And better than the North Pole. Amazing!

Can ChatGPT actually play chess now? Last I checked, it couldn't remember more than 5 moves of history so it wouldn't be able to see the true board state and would make illegal moves, take it's own pieces, materialize pieces out of thin air, etc.

Ah, you used logic. That's the issue. They don't do that.

Hardly surprising. Llms aren't -thinking- they're just shitting out the next token for any given input of tokens.

It's not that hard to beat dumb 6 year old who's only purpose is mine your privacy to sell you ads or product place some shit for you in future.

This made my day

Using an LLM as a chess engine is like using a power tool as a table leg. Pretty funny honestly, but it's obviously not going to be good at it, at least not without scaffolding.

You say you produce good oranges but my machine for testing apples gave your oranges a very low score.

I mean, that 2600 Chess was built from the ground up to play a good game of chess with variable difficulty levels. I bet there's days or games when Fischer couldn't have beaten it. Just because a thing is old and less capable than the modern world does not mean it's bad.