How to measure AI developer productivity in 2025 | Nicole Forsgren

A lot of companies are trying to measure productivity. For their teams. Most productivity metrics are a lie. If the goal is more lines of code, I can prompt something to write the longest piece of code ever. It's just too easy to gain that system. How do I know if my edge team is moving fast enough if they can move faster, if they're just not performing as well as they can? Most teams can move faster, but faster for what? We can ship trash fast. Faster every single day. We need strategy and really smart decisions to know what to ship. One of the biggest issues we're gonna probably have with AI is learning how much to trust code. That it generates. We can't just put in a command and get something back and accept it. We really need to evaluate it. You know, are we seeing hallucinations? What's the reliability? Does it meet the style that we would typically write? So much of the time is now gonna be spent reviewing code versus writing code. There's some real opportunity there to not just rethink workflows, but rethink how we structure our days and how we structure our work. Now we can also make A 45 minute work block useful because getting into the flow is actually kind of handed off, at least in part to the machine, or the machine can help us get back into the flow by reminding us of context and generating diagrams of the system. What's just like one thing that you think an edge team, a product team can do this week, next week to get more done. Honestly, I think the best thing you can do.

Today my guest is Nicole Forsgren. With so much talk about how AI is increasing developer productivity. More and more people are asking. How do we measure this productivity gain? And are these AI tools actually helping us or hurting how our developers work?

Nicole has been at the forefront of this space longer than anyone. She created the most used frameworks for measuring developer experience. Called Dora and Space. She wrote the most important book in the space called Accelerate, and is about to publish her newest book called Frictionless, which gives you a guide to helping your team move faster and do more in this emerging AI world. Her core thesis is that AI indeed accelerates coding.

We already have this episode, so unlocking it is cheap and permanent: the full transcript, segment and word-level timestamps, and .txt, .srt, .vtt and word-level JSON downloads, as many times as you like, forever.

10 free credits is 10 episodes like this one a month. Episodes nobody has transcribed yet cost their length in hours, because we have to actually transcribe them.