AI may Outperform Most Humans at Creative Thinking Task

Large language model (LLM) artificial intelligence (AI) chatbots may be able to outperform the average human at a creative thinking task where the participant devises alternative uses for everyday objects (an example of divergent thinking), suggests a study published in Scientific Reports. However, the human participants with the highest scores still outperformed the best chatbot responses.

Divergent thinking is a type of thought process commonly associated with creativity that involves generating many different ideas or solutions for a given task. It is commonly assessed with the Alternate Uses Task (AUT), in which participants are asked to come up with as many alternative uses for an everyday object as possible within a short time period. The responses are scored for four different categories: fluency, flexibility, originality, and elaboration.

Mika Koivisto and Simone Grassini compared 256 human participants’ responses with those of three AI chatbots' (ChatGPT3, ChatGPT4, and Copy.Ai) to AUTs for four objects - a rope, a box, a pencil, and a candle. The authors assessed the originality of the responses by rating them on semantic distance (how closely related the response was to the object's original use) and creativity. A computational method was used to quantify semantic distance on a scale from 0 to 2, whilst human evaluators, blind to the originators of the responses, subjectively rated creativity from 1 to 5. On average, the chatbot-generated responses scored significantly higher than the human responses for both semantic distance (0.95 vs 0.91) and creativity (2.91 vs 2.47). The human responses had a far greater range in both measures - the minimum scores were much lower than for the AI responses, but the maximum scores were generally higher. The best human response outperformed each chatbot’s best response in seven out of eight scoring categories.

These findings suggest that AI chatbots can now generate creative ideas at least as well as the average human. However, the authors note that they only considered performance in a single task associated with the assessment of creativity. The authors propose that future research could explore how AI can be integrated into the creative process to improve human performance.

Koivisto M, Grassini S.
Best humans still outperform artificial intelligence in a creative divergent thinking task.
Sci Rep. 2023 Sep 14;13(1):13601. doi: 10.1038/s41598-023-40858-3

Most Popular Now

Researchers Invent AI Model to Design Ne…

Researchers at McMaster University and Stanford University have invented a new generative artificial intelligence (AI) model which can design billions of new antibiotic molecules that are inexpensive and easy to...

ChatGPT can Produce Medical Record Notes…

The AI model ChatGPT can write administrative medical notes up to ten times faster than doctors without compromising quality. This is according to a new study conducted by researchers at...

Alcidion and Novari Health Forge Strateg…

Alcidion Group Limited, a leading provider of FHIR-native patient flow solutions for healthcare, and Novari Health, a market leader in waitlist management and referral management technologies, have joined forces to...

Greater Manchester Reaches New Milestone…

Radiologists and radiographers at Northern Care Alliance NHS Foundation Trust have become the first in Greater Manchester to use the Sectra picture archiving and communication system (PACS) to report on...

Powerful New AI can Predict People'…

A powerful new tool in artificial intelligence is able to predict whether someone is willing to be vaccinated against COVID-19. The predictive system uses a small set of data from demographics...

Can Language Models Read the Genome? Thi…

The same class of artificial intelligence that made headlines coding software and passing the bar exam has learned to read a different kind of text - the genetic code. That code...

Advancing Drug Discovery with AI: Introd…

A transformative study published in Health Data Science, a Science Partner Journal, introduces a groundbreaking end-to-end deep learning framework, known as Knowledge-Empowered Drug Discovery (KEDD), aimed at revolutionizing the field...

Study Shows Human Medical Professionals …

When looking for medical information, people can use web search engines or large language models (LLMs) like ChatGPT-4 or Google Bard. However, these artificial intelligence (AI) tools have their limitations...

Bayer and Google Cloud to Accelerate Dev…

Bayer and Google Cloud announced a collaboration on the development of artificial intelligence (AI) solutions to support radiologists and ultimately better serve patients. As part of the collaboration, Bayer will...

Wanted: Young Talents. DMEA Sparks Bring…

9 - 11 April 2024, Berlin, Germany. The digital health industry urgently needs skilled workers, which is why DMEA sparks focuses on careers, jobs and supporting young people. Against the backdrop of...

Shared Digital NHS Prescribing Record co…

Implementing a single shared digital prescribing record across the NHS in England could avoid nearly 1 million drug errors every year, stopping up to 16,000 fewer patients from being harmed...

Ask Chat GPT about Your Radiation Oncolo…

Cancer patients about to undergo radiation oncology treatment have lots of questions. Could ChatGPT be the best way to get answers? A new Northwestern Medicine study tested a specially designed ChatGPT...