AI systems are becoming increasingly powerful, and people are increasingly using them to build the next generation of AI. We want to show this progress to the public.
AI systems are becoming increasingly powerful, and people are increasingly using them to build the next generation of AI. We want to show this progress to the public.
Today, we share three metrics that help track AI development:
1. How much AI R&D work is done by AI.
2. How effective AI agents are at being supervised.
3. How compute is allocated.
We provide a snapshot of these metrics from within Anthropic. Any frontier developer can publish the same metrics, and third parties can verify them.
As the world considers how to control the pace of frontier AI development, we should do everything possible to narrow the gap between what frontier labs know and what the public knows. This means better measuring AI development, publishing our findings, and giving society the opportunity to decide how to use this information.
Read the full article and methodology: https://t.co/iPFz8Z4ugE