ChatGPT Can Now Pass Theory of Mind Test
New research shows that the latest ChatGPT versions can answer 93% of Theory of Mind Test questions - the level a 9-year-old can reach.
The Theory of Mind Test measures a person's ability to understand others have different thoughts, emotions, beliefs, and intentions. One task involves showing a child a box labeled "Smarties" and asking what they think is inside. The child says "Smarties." Then, they are shown the box contains pencils. They are asked what another child who hasn't seen the box would say is inside. If the child says "Smarties," they passed the test.
Stanford University psychologist Michal Kosinski tested ChatGPT versions to see if they could show Theory of Mind abilities. He found that the November 2022 version answered 93% of questions, compared to the January 2022 version of GPT-3, which answered 70% - the level a 7-year-old reaches.
Kosinski calls this a "new phenomenon." It's possible the chatbot solved the questions by finding unknown language patterns instead of using Theory of Mind. Another possibility is that language models are developing Theory of Mind-like abilities as they become more complex and better at human-like language generation and interpretation.
Kosinski believes that AI's ability to understand others' cognitive and emotional states will greatly improve communication with humans and other AI systems. It could also lead to abilities like empathy, moral judgment, and self-consciousness.
#ChatGPT
#TheoryOfMind
#AI
#Psychology
#LanguageModels
#Communication
#HumanInteraction