Commentary

Almost Human AI: GenAI-Created Ads Did As Well In Study As Those Created By People

Scoff if you must, but AI-generated ads performed at the same level as those created by humans in a new study from Taboola.  

They did it by appearing more human—i.e., with “trust signals” like a big human face. Moreover, they did it more effectively than actual human designers, according to the study, which was done by researchers from Columbia, Harvard, TUM, and CMU. Indeed, AI-generated ads were more likely to include these trust signals than human-made creative. 

“By analyzing over 500 million impressions, we were able to move past the hype of GenAI and uncover its real impact in large scale settings,” says Oded Netzer, vice dean for research, Columbia Business School. “Our findings prove that when AI is used to enhance human cues—like the trust found in a human face—it doesn't just match human performance; it often sets a new ceiling for engagement.” 

advertisement

advertisement

What this means for publishers is not yet clear. It may help advertisers get creative out more quickly and keep their costs down. But we hope that they don’t start testing whether AI can out-perform human journalists, as we are sure some have already done.  

The study utilized what it called a quasi-experimental "sibling ads" approach. It compared matched pairs of AI-generated and human-made ads created by the same advertiser for the same campaign, and on the same day.  

Researchers were thus able to isolate the impact of the GenAI creative while controlling external variables such as the identity of the advertiser and factors like timing, audience targeting and landing pages. 

The research found that in raw data AI achieved an average click-through rate of 0.76%, compared with 0.65% for human-generated ads. However, they showed comparable performance when very tight statistical controls were applied.  

AI ads that did not look like AI drove the highest engagement levels of all groups, outperforming human-made ads and AI that were seen as artificial.  

The study analyzed hundreds of thousands of live ads running on Taboola’s performance advertising platform Realize. There were more than 500 million impressions and three million clicks. 

“Taboola’s platform provided us with a literal gold mine of real-world data that is simply unavailable in a lab setting,” Netzer adds.

 

Next story loading loading..