Latest
  1. Johns Hopkins Bayview tells 3,182 patients an employee put their health data into a public AI tool
  2. China’s AI compute access expected to double in 2027, with US-designed chips about 65 per cent
  3. UK commits £100m to national AI Biosecurity Lab
  4. Moonshot AI releases Kimi K3.1 Pro with 1-million-token context window
  5. Residents in Newport and Cardiff oppose hyperscale datacentres near homes
  6. Study: Grok 4.7 picked Republicans in 92% of forced midterm answers, GPT-6.1 Sol picked Democrats in 97%
  7. Attackers exploiting the PHP flaws hand the break-in to AI agents, Unit 42 says
  8. Elvis Presley’s rightsholders sue Anthropic over training on 274 songs

Latest / Health and life sciences

ResearchHealthUS InternationalConfirmed

OpenAI publishes HealthBench, 5,000 health conversations graded by 262 physicians

See how this story connects

Source: OpenAI

OpenAI released HealthBench, an open benchmark of 5,000 realistic health conversations, each with a grading rubric written by physicians, built with 262 doctors who have practised in 60 countries.

Why it matters

Hospitals, regulators and developers gained a physician-built yardstick for chatbot health answers, which OpenAI later used to report gpt-oss results.

When
12 May 2025
ID
WTA-N-2025-0179
Who
OpenAI

Summary by wheresthe.ai, from OpenAI. Checked against the source on 9 Oct 2026.

Read the original at OpenAI

Source copy: download the page text as saved on 18 Oct 2026 (PDF). Also held by the Internet Archive.

Cite this story

WTA-N-2025-0179: “OpenAI publishes HealthBench, 5,000 health conversations graded by 262 physicians.” wheresthe.ai, 12 May 2025. https://wheresthe.ai/d/openai-healthbench-2025-05/ (source: OpenAI).

Spotted an error? Email [email protected].