Introducing MentalHealthBench
OpenAI has released MentalHealthBench, a benchmark designed with expert input. It assesses whether AI responses are helpful and safe in realistic conversations about mental health.
Safety & security
207 stories · Page 5/5Priorities and principles for effective third party assessments
OpenAI sets out what it considers necessary for independent safety assessments of frontier models and their safeguards. It stresses rigor, security and independence.
How UK AISI and EvalEval Are Making Benchmark Results Reproducible
A Hugging Face post covers work by the UK AI Security Institute and the EvalEval initiative to make AI benchmark results reproducible.
Why Deploying Physical AI at Scale Demands Safety at Every Layer
NVIDIA argues that robots and autonomous vehicles need safety built into every layer as they move from research into shared spaces. It cites analyst forecasts of tens of millions of autonomous vehicles and industrial robots deployed over the next decade.
Building standards for the next phase of AI
OpenAI proposes a route toward shared international AI standards. It calls for coordinated evaluation, reporting and governance to make AI safer.
Introducing the Australian Youth Safety Blueprint
OpenAI has released a six-pillar roadmap for Australia meant to make AI experiences safer for young people. The blueprint also aims to give them more control over how they use AI.
Our framework for reporting model misalignment
OpenAI has published a framework for tracking, investigating and disclosing cases where its models behave in misaligned ways. It released six reports on unexpected or concerning model behavior at the same time.