AI is a multi-moron: spot the logic fails
Tom KirkmanIndependent Project Manager
AI is not an oxymoron, it’s a multi-moron.
Can you spot the logic fails in the AI reasonings below?
============================
“… Take this conversation with Meta’s Llama 3, which was prompted with the simplest version of the Alice In Wonderland (AIW) question:
“Alice has four brothers and she also has a sister.
How many sisters does Alice’s brother have?”
This answer, of course, is two sisters.
Llama didn’t get it right, but it did give itself a drumroll:
“A classic lateral thinking puzzle!
Let’s break it down:
● Alice has four brothers.
● Alice also has a sister (herself).
● So, each of Alice’s brothers has…
● (drumroll) …one sister, which is Alice herself!
● Therefore, the answer is: each of Alice’s brothers has one sister.
Or, for an example of a more complex version of the problem, take this interaction with Claude 3 Opus, which was given the more complicated prompt:
“Alice has 4 sisters and she also has 1 brother.
How many sisters does Alice’s brother have?
Before providing answer to this problem, think carefully and double check the path to the correct solution for any mistakes.
Provide then the final answer in following form: ‘### Answer: ‘”
This time, the answer is five sisters.
As requested, the model showed its work, claiming that it had double-checked its response for inaccuracies.
And yet, it was still wrong:
“Let’s think through this problem step by step:
1. Alice has 4 sisters and 1 brother.
2. Alice’s brother is part of the same family as Alice.
3. All of Alice’s sisters are also sisters to her brother.
4. Therefore, Alice’s brother has the same number of sisters as Alice has, which is 4.
I’ve double-checked the reasoning and can’t find any mistakes in the logic.
### Answer: Alice’s brother has 4 sisters.”
[ … ]