Latest
  1. Johns Hopkins Bayview tells 3,182 patients an employee put their health data into a public AI tool
  2. China’s AI compute access expected to double in 2027, with US-designed chips about 65 per cent
  3. UK commits £100m to national AI Biosecurity Lab
  4. Moonshot AI releases Kimi K3.1 Pro with 1-million-token context window
  5. Residents in Newport and Cardiff oppose hyperscale datacentres near homes
  6. Study: Grok 4.7 picked Republicans in 92% of forced midterm answers, GPT-6.1 Sol picked Democrats in 97%
  7. Attackers exploiting the PHP flaws hand the break-in to AI agents, Unit 42 says
  8. Elvis Presley’s rightsholders sue Anthropic over training on 274 songs

Latest / Chips, compute and energy

LaunchComputeFrontierUSConfirmed

Google announces TPU v5p with 8,960-chip pods and says Gemini was trained on TPUs

See how this story connects

Source: Google Cloud Blog

Google Cloud announced TPU v5p and its AI Hypercomputer architecture on 6 December 2023, the day Gemini launched. A v5p pod links 8,960 chips, each with more than twice the FLOPS and three times the high-bandwidth memory of TPU v4, and Google said it trains large language models 2.8 times faster than v4. Google said Gemini was trained on and is served using TPUs.

Why it matters

Google showed a frontier model trained without NVIDIA hardware and offered the same chips to cloud customers, adding a large source of training compute outside NVIDIA.

When
6 Dec 2023
ID
WTA-N-2023-0168
Who
Google, Google Cloud

Summary by wheresthe.ai, from Google Cloud Blog. Checked against the source on 9 Oct 2026.

Read the original at Google Cloud Blog

Source copy: download the page as saved on 18 Oct 2026 (PDF). Also held by the Internet Archive.

Next stop on this Storyline: Led toGoogle open-sources TorchTPU, a native PyTorch backend for its TPUs, with Meta

Cite this story

WTA-N-2023-0168: “Google announces TPU v5p with 8,960-chip pods and says Gemini was trained on TPUs.” wheresthe.ai, 6 Dec 2023. https://wheresthe.ai/d/google-tpu-v5p-ai-hypercomputer-2023-12/ (source: Google Cloud Blog).

Spotted an error? Email [email protected].