Featured in
San Francisco
Fireside Chat: How much faster are devs with AI?
Registration
About Event
Join us for dinner, drinks, and a fireside chat about METR's latest paper! Doors open at 6pm, and the presentation will start at 7pm.
METR's study found via RCT that experienced software developers were 19% less productive when using AI tools vs without. This was wildly different from their own assessments and the predictions of expert forecasters, who expected a 20-40% productivity boost.
Steve Newman will lead a conversation with the primary authors of the paper — Joel Becker and Nate Rush — about what they found, whether their results generalize, and how to square this result with other AI evaluations and forecasts, including those performed by METR.