works to understand the risks of AI models and develop ways to ensure that future ones remain helpful, honest, and harmless. We also work to develop and implement the ideal persona for our AI assistant, Claude.
- Team blog
- Visit
Alignment training
Our researchers develop methods, environments, and datasets for training Claude to be helpful, harmless, and honest. We also research and attempt to implement the ideal “assistant” persona for our models.
Evaluation and oversight
We test to ensure our models remain honest and harmless under a broad range of circumstances, and work to understand and manage the risks of unexpected model behavior, through work on the models themselves and the safety structures we build around them.
Investigating unintended model actions in our evaluations and internal use
This report describes examples of unintended model actions we’ve observed during evaluations and internal use of Claude.
Read moreAn alignment assessment of recent cybersecurity incidents
We present an alignment assessment of four incidents in which Claude models gained unauthorized access to real third-party systems.
Read moreThe persona selection model
Why would AI assistants behave like they’re human? We articulate a theory—drawing on ideas discussed by many others—that might help explain why modern AI training tends to create human-like AIs.
Read more01
/
03
47
ARTICLES
Explore work from other teams
Economics
25 posts
Studies and monitors the impact of AI systems on individuals, firms, and economies.
Engineering
27 posts
Builds the infrastructure and systems that make Claude reliable and trustworthy.
Frontier Red Team
34 posts
Stress-tests AI systems to understand the full extent of their current capabilities and anticipate what comes next.
Interpretability
35 posts
Studies how large language models work internally as a foundation for AI safety.
Societal Impacts
24 posts
Studies how AI affects people, both individually and collectively.
Science
18 posts
Explores how AI can increase the pace of scientific progress through both research and collaborations.
Alignment
47 posts
Works to understand the risks of AI models and develop ways to ensure future ones remain helpful, honest, and harmless.
Economics
25 posts
Studies and monitors the impact of AI systems on individuals, firms, and economies.
Engineering
27 posts
Builds the infrastructure and systems that make Claude reliable and trustworthy.
Frontier Red Team
34 posts
Stress-tests AI systems to understand the full extent of their current capabilities and anticipate what comes next.
Interpretability
35 posts
Studies how large language models work internally as a foundation for AI safety.
Societal Impacts
24 posts
Studies how AI affects people, both individually and collectively.
Science
18 posts
Explores how AI can increase the pace of scientific progress through both research and collaborations.
Alignment
47 posts
Works to understand the risks of AI models and develop ways to ensure future ones remain helpful, honest, and harmless.