AI may Outperform Most Humans at Creative Thinking Task

Large language model (LLM) artificial intelligence (AI) chatbots may be able to outperform the average human at a creative thinking task where the participant devises alternative uses for everyday objects (an example of divergent thinking), suggests a study published in Scientific Reports. However, the human participants with the highest scores still outperformed the best chatbot responses.

Divergent thinking is a type of thought process commonly associated with creativity that involves generating many different ideas or solutions for a given task. It is commonly assessed with the Alternate Uses Task (AUT), in which participants are asked to come up with as many alternative uses for an everyday object as possible within a short time period. The responses are scored for four different categories: fluency, flexibility, originality, and elaboration.

Mika Koivisto and Simone Grassini compared 256 human participants’ responses with those of three AI chatbots' (ChatGPT3, ChatGPT4, and Copy.Ai) to AUTs for four objects - a rope, a box, a pencil, and a candle. The authors assessed the originality of the responses by rating them on semantic distance (how closely related the response was to the object's original use) and creativity. A computational method was used to quantify semantic distance on a scale from 0 to 2, whilst human evaluators, blind to the originators of the responses, subjectively rated creativity from 1 to 5. On average, the chatbot-generated responses scored significantly higher than the human responses for both semantic distance (0.95 vs 0.91) and creativity (2.91 vs 2.47). The human responses had a far greater range in both measures - the minimum scores were much lower than for the AI responses, but the maximum scores were generally higher. The best human response outperformed each chatbot’s best response in seven out of eight scoring categories.

These findings suggest that AI chatbots can now generate creative ideas at least as well as the average human. However, the authors note that they only considered performance in a single task associated with the assessment of creativity. The authors propose that future research could explore how AI can be integrated into the creative process to improve human performance.

Koivisto M, Grassini S.
Best humans still outperform artificial intelligence in a creative divergent thinking task.
Sci Rep. 2023 Sep 14;13(1):13601. doi: 10.1038/s41598-023-40858-3

Most Popular Now

AI Body Composition Measurements can Pre…

Adiposity - or the accumulation of excess fat in the body - is a known driver of cardiometabolic diseases such as heart disease, stroke, type 2 diabetes, and kidney disease...

AI can Strengthen Pandemic Preparedness

How to identify the next dangerous virus before it spreads among people is the central question in a new Comment in The Lancet Infectious Diseases. In it, researchers discuss how...

'Future-Guided' AI Improves Se…

In the world around us, many things exist in the context of time: a bird’s path through the sky is understood as different positions over a period of time, and...

New AI Tool Scans Social Media for Hidde…

A new artificial intelligence tool can scan social media data to discover adverse events associated with consumer health products, according to a study published September 30th in the open-access journal...

Study Finds One-Year Change on CT Scans …

Researchers at National Jewish Health have shown that subtle increases in lung scarring, detected by an artificial intelligence-based tool on CT scans taken one year apart, are associated with disease...

Yousif's Story with Sectra and The …

Embarking on healthcare technology career after leaving his home as a refugee during his teenage years, Yousif is passionate about making a difference. He reflects on an apprenticeship in which...

New AI Tools Help Scientists Track How D…

Artificial intelligence (AI) can solve problems at remarkable speed, but it’s the people developing the algorithms who are truly driving discovery. At The University of Texas at Arlington, data scientists...

AI Tool Offers Deep Insight into the Imm…

Researchers explore the human immune system by looking at the active components, namely the various genes and cells involved. But there is a broad range of these, and observations necessarily...

New Antibiotic Targets IBD - and AI Pred…

Researchers at McMaster University and the Massachusetts Institute of Technology (MIT) have made two scientific breakthroughs at once: they not only discovered a brand-new antibiotic that targets inflammatory bowel diseases...

Highland to Help Companies Seize 'N…

Health tech growth partner Highland has today revealed its new identity - reflecting a sharper focus as it helps health tech companies to find market opportunities, convince target audiences, and...