Measuring AI Ability to Complete Long Tasks

Published: 1 week ago (December 20, 2025 at 11:06 PM EST)

1 min read

Source: Hacker News

Article Details

Article URL: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
Comments URL: https://news.ycombinator.com/item?id=46342166
Points: 160
Comments: 102

Measuring AI Ability to Complete Long Tasks: Opus 4.5 has 50% horizon of 4h49M

Article URL: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ Comments URL: https://news.ycombinator.com/item?id=46342166 Points: 3...

How to Build an AI Agent Evaluation Framework That Scales

The Scaling Problem So, you've built a great AI agent. You've tested it with a few dozen examples, and it works perfectly. Now, you're ready to deploy it to pr...

Gemini 3 Pro scores 69% trust in blinded testing up from 16% for Gemini 2.5: The case for evaluating AI on real-world trust, not academic benchmarks

Just a few short weeks ago, Google debuted its Gemini 3 model, claiming it scored a leadership position in multiple AI benchmarks. But the challenge with vendor...

ChatLLM Presents a Streamlined Solution to Addressing the Real Bottleneck in AI

For the last couple of years, a lot of the conversation around AI has revolved around a single, deceptively simple question: Which model is the best? But the ne...

Article Details

Related posts

Measuring AI Ability to Complete Long Tasks: Opus 4.5 has 50% horizon of 4h49M

How to Build an AI Agent Evaluation Framework That Scales

Gemini 3 Pro scores 69% trust in blinded testing up from 16% for Gemini 2.5: The case for evaluating AI on real-world trust, not academic benchmarks

ChatLLM Presents a Streamlined Solution to Addressing the Real Bottleneck in AI