Google: How Much Energy AI Uses


Power-thirsty data centers are dominating the news cycle with Google, Meta, Microsoft, and others spending billions to support artificial intelligence.

Advertisers concerned about using too much energy or harming the environment through searches or media buys may want to consider another way to connect with potential and existing customers.

For advertisers that are storing data, searches or making media buys, they may want to consider another way to connect with potential and existing customers.

The median energy use of one text prompt on Google Gemini is equivalent to watching TV for less than nine seconds and consumes five drops of water, the company said in a new research paper. It emits 0.03 grams of carbon dioxide. The company is proud of its findings, because the figures are substantially lower than many public estimates, it wrote in a post.

advertisement

advertisement

Google this week released a methodology to determine how much electricity and water a full-stack AI infrastructure requires. It includes everything from overhead to energy used by idle chips -- even ways to cool the equipment to ensure they do not overheat.

Software efficiencies and clean energy have lowered the median energy consumption of a Gemini Apps text prompt by 33x during the last year and CO2 by 44x, the company wrote in the post.

During the past 12 months, the energy and total carbon footprint of the median Gemini apps text prompt dropped by 33x and 44x, respectively, while delivering higher-quality responses, the company wrote.

"We are not just measuring the power from chips -- we also look at used TPUs and GPUs in Google's system," said Savannah Goodman, head of Advanced Energy Labs at Google, in a video. "The energy consumption, carbon emissions and water consumptions were a lot lower than what he have been seeing in some public estimates."

The research paper, released Thursday also suggests that despite all this progress in AI, the industry lacks first-party data from the largest AI model providers, and that needs to change.

Lack of a consensus has led to published estimates for similar AI tasks, and a lack of agreement regarding methodologies may have contributed to a lack of first-party data when it is needed most.

"Google has a unique perspective on the operational realities of maintaining a large-scale, globally-distributed AI production fleet, and serving software products at scale—such as web search," according to the paper.

The paper also went on to describe ways to characterize and optimize "environmental impact of AI model serving requires a comprehensive view of energy consumption—including the power drawn by the host machine’s CPU and DRAM, the significant energy consumed by idle systems provisioned for reliability and low latency, and the full data center overhead as captured by the Power Usage Effectiveness (PUE) metric."


Next story loading loading..