Latest / Frontier models and safety
DeepSeek releases V3, a 671B open-weights model trained on 2.788M H800 GPU hours
See how this story connectsChinese lab DeepSeek released DeepSeek-V3 on 26 December 2024, a mixture-of-experts model with 671 billion parameters, 37 billion active per token, and published the weights and a technical report. The report says pre-training used 14.8 trillion tokens, full training took 2.788 million H800 GPU hours, and the model outperforms other open-source models and is comparable to leading closed ones. Standard API prices from 8 February 2025 were 2 yuan per million input tokens on a cache miss and 8 yuan per million output tokens.
Why it matters
Developers anywhere could download a Chinese model its makers said rivalled leading closed systems, with a disclosed training budget of 2.788 million H800 GPU hours.
- When
- 26 Dec 2024
- ID
WTA-N-2024-0050- Where
- China
- Who
- DeepSeek, NVIDIA
Summary by wheresthe.ai, from DeepSeek API Docs and the reporting credited above. Checked against the source on 9 Oct 2026.
Source copy: download the page as saved on 18 Oct 2026 (PDF). Also held by the Internet Archive.
Cite this story
WTA-N-2024-0050: “DeepSeek releases V3, a 671B open-weights model trained on 2.788M H800 GPU hours.” wheresthe.ai, 26 Dec 2024. https://wheresthe.ai/d/cn-deepseek-v3-release-2024-12/ (source: DeepSeek API Docs).
Spotted an error? Email [email protected].