General AI Crap

I’m back on the Claude train, currently my main LLM of choice.

Having said I’ve seen some serious “flattery” lately & one messed up hallucination case.

It thought I was based in PTA, I’ve never once ever mentioned PTA to it.

“You’re a good fit for this role, one possible disadvantage is that this hybrid role is based in Cape Town & you’re based in Pretoria.”

The “confidence” was most impressive 🤣😂
 
Human Reasoning vs AI Pattern Matching...

Apple has published a paper with a devastating title: “The Illusion of Thinking”

It argues that AI models, no matter how brilliant they may seem, do not understand what they are doing. They do not solve problems. They do not reason. They merely generate text word by word, trying to sound coherent.

Apple tested the most advanced reasoning models in the world on controlled puzzle environments. They tore open the internal "thinking" traces.

What they found shatters the narrative that we are getting closer to AGI. Current models don't scale with complexity. They have a hard mathematical cliff. And they do not degrade gracefully. They collapse.

But here is the most unsettling part. When a problem gets too complex, the AI doesn't use its remaining compute to try harder. It just gives up. Its reasoning effort actually declines. It stops thinking and starts guessing.

Then Apple ran the experiment that closes the casket on the reasoning debate. They gave the AI the exact, step-by-step algorithm to solve the puzzle. The cheat codes. All the AI had to do was follow the instructions.

It couldn't do it. Performance didn't improve at all.

When the complexity gets high enough, these models fail because they cannot actually execute a logical sequence. They are not reasoning. They are just pattern matching.

When you give them a simple problem, they overthink. When you give them a hard problem, they collapse.

Paper: The Illusion of Thinking, Apple, 2025
Click to expand...

https://twitter.com/x/status/2057021097946869994
 
I’ve been playing 10 minute games on chess.com the past few years and can’t really get past level 500. So started using the London opening the past two weeks and it seems to improve my win rate.

So I asked chatgpt what is the equivalent of that opening if you play black and it came up with this gem.

F497991C-8F25-4B85-8565-EF6FE56A596F.png
 
purrr said:
I’ve been playing 10 minute games on chess.com the past few years and can’t really get past level 500. So started using the London opening the past two weeks and it seems to improve my win rate.

So I asked chatgpt what is the equivalent of that opening if you play black and it came up with this gem.

View attachment 1909743
Click to expand...
I have obviously not been keeping up with the new initiatives in the game, maybe I should ask ChatGPT about this.
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X