Introducing MentalHealthBench
OpenAI has released MentalHealthBench, a benchmark designed with expert input. It assesses whether AI responses are helpful and safe in realistic conversations about mental health.
Related stories
Sam Altman’s remarks at the United Nations Security Council
OpenAI CEO Sam Altman addressed the UN Security Council. He spoke about AI safety, keeping humans in control and the need for international cooperation.
OpenAI extends cyber access to Ukraine for civilian defense
OpenAI is giving Ukraine’s government access to its Daybreak program. The aim is to support the cyber defense of civilian infrastructure.
Advancing Private AI Compute with secure, server-side memory
Google is adding private, server-side memory to Private AI Compute, its system for personal AI. The feature is designed to keep users’ data protected.
Priorities and principles for effective third party assessments
OpenAI sets out what it considers necessary for independent safety assessments of frontier models and their safeguards. It stresses rigor, security and independence.
How UK AISI and EvalEval Are Making Benchmark Results Reproducible
A Hugging Face post covers work by the UK AI Security Institute and the EvalEval initiative to make AI benchmark results reproducible.