Ensuring AIs are aligned to their specs, and target behaviours benefit humanity.
AIs are trained to behave according to a “model spec” (or “constitution”) that details intended behaviours and values. We research how to design specs that can ensure AI benefits humanity, and evaluate whether AI propensities align with the spec in practice.
Research
People
Founder
Robert has researched chain-of-thought monitoring, reward hacking, and LLM steganography. He has published in top conferences (e.g., NeurIPS, ICML), and with OpenAI and Google DeepMind co-authors.
RM
OT