A comprehensive new study by Springboards, an AI platform inspiring creativity in advertising, found that popular AI tools like ChatGPT, Gemini, Claude and others perform much more similarly on creative tasks than many people think. Creativity Benchmark, conducted in collaboration with the 4As, ACA, APG, D&AD, IAA, IPA, and The One Club for Creativity, challenges the idea that there’s a single “best” AI tool for creative work and shows agencies need more efficient ways to test AI tools for their specific needs.
Sixteen different AI systems – from OpenAI, Google, Anthropic, Meta, DeepSeek, Alibaba and others – were tested on real marketing challenges across 100 notable brands. Over 600 creative professionals from ad agencies, marketing teams, and strategy firms made over 11,000 comparisons to see which ones worked best. The biggest surprise? There was no clear winner. The differences between the “best” and “worst” AI tools were much smaller than expected.
Marketing Technology Insights: The Impact Lab Launches To Help Brands Get More From Amazon Ads
“Everyone assumes some AI tools are way better than others for creative work,” said Pip Bingemann, CEO and co-founder of Springboards. “But our tests showed the results were pretty close. Why? Because these models are machines designed to recognize patterns and give you the most probable answer—and ‘probable’ has never been called ‘creative.’ Keeping humans in the loop and optimizing for a wider range of varied ideas is crucial.”
The study looked at three types of creative challenges: finding surprising insights about consumers, creating big campaign ideas, and coming up with bold, attention-grabbing concepts.
Key Findings:
- Different AI Tools Win at Different Tasks: No single AI system was best at everything. Some were better at strategic thinking, others at wild, creative ideas. This means agencies might want to use different tools for different jobs.
- Variety of Ideas Matters Most: Some AI tools generated lots of different creative options for the same brief. Others kept suggesting similar ideas over and over. For real creative work, having many different options is just as important as having good ones.
- AI Can’t Judge Creative Work Well: When researchers had AI systems evaluate creative ideas, they gave very different scores than human experts. This means agencies can’t rely on AI to pick the best creative concepts – they still need human judgment.
- Standard Creativity Tests Don’t Work for Marketing: Traditional creativity tests used in psychology don’t predict which AI will be better at marketing-specific creative tasks. Brand work requires its own way of measuring creativity.
- Creative Preferences Vary by Location: Interestingly, creative professionals in different countries preferred different AI tools, suggesting that cultural differences affect what people consider good creative work.
Marketing Technology Insights: Iterable Appoints Priya Gill as CMO and Nick Beil as CPO To Accelerate Product Innovation
“LLMs aren’t a one-size-fits-all solution—they’re general purpose tools that require human creativity to unlock breakthrough outcomes,” said Jeremy Lockhorn, SVP, Creative Technologies & Innovation, 4As. “These findings suggest agencies and brands should continue to evaluate which models are best suited for creative work – and that a multi-model approach may well be the best path forward.”
“This study highlights that creativity isn’t about which AI you use, it’s about how you use it,” remarked Tony Hale, CEO, Advertising Council Australia. “The results reinforce what we see across the industry: the human spark remains essential to transforming good ideas into great ones. For agencies, the real opportunity is learning how to collaborate with these systems to expand, not replace, creative thinking.”
Marketing Technology Insights: Uptempo 2.0 Empowers CMOs To Drive Efficiency and Boost ROI Across Enterprise Marketing
Source – GlobeNewswire
For media inquiries, you can write to our MarTech Newsroom at sudipto@intentamplify.com
