Combine automated evals with human bashing
ProductAutomated metrics are necessary but insufficient; internal teams and external contractors must actively try to break the product to find subtle flaws.
Supporting quotes
there are all kinds of subtle things that you can change about the way you interact with the model that can give you very different results.
There's this whack- a-mole aspect where you push on one thing and these other things start to move as well that you may not even notice or measure.
Source Dario Amodei Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity | Lex Fridman Podcast #452 - Lex Fridman, 2024 (opens in a new tab)
1 more supporting quote is in the member records.






