Google's Quest for AI Efficiency

Google is working on a new AI chip, internally dubbed "Frozen v2," which promises to make its in-house Gemini models operate more efficiently. According to a report by The Information, the chip could be between six and 10 times more efficient than Google's existing AI chips, measured by the number of tokens generated per unit of power.

"Our teams are constantly researching and experimenting with new innovations to deliver maximum performance and efficiency for our users and customers," Google told TechCrunch.

The Rise of Custom Chips in AI

AI companies have increasingly sought to produce their own chips as a way to make their in-house models run more efficiently and to address global shortages in AI computing capacity. Such efficiency has become a key selling point for tech companies as concerns about AI spend have dampened the market euphoria that previously characterized the industry.

• OpenAI has already announced its first custom chip, an inference processor dubbed Jalapeño.
• Anthropic is discussing a new chipmaking partnership with Samsung.
• Investors have previously worried about Alphabet's massive planned expenditures designed to help it build out its AI strategy.

Frozen v2: A Game-Changer?

News of the more efficient Frozen v2 chip appears to have assuaged investors, giving Google a boost ahead of its earnings report later this week. The company's stock climbed some 3% on Monday morning following publication of The Information's report.

• The move is part of Google's strategy to reduce its reliance on chipmaker Nvidia, which has historically dominated the AI chip market.
• The company needs to prove that its investments will pay off, with plans to spend between $180 billion and $190 billion on its AI strategy.
• Frozen v2 could be a game-changer for Google's AI operations, making its Gemini models more efficient and reducing costs.