transcript · 12,751 words

Why experts writing AI evals is creating the fastest-growing companies in history | Brendan Foody (CEO of Mercor)

Transcribed with NVIDIA Parakeet · Timestamps stay in sync with the live audio

The wealthiest companies in the world are willing to spend whatever it takes to improve model capabilities. We're entering the era of evals. We start working with all the top AI labs. What the labs need is labor marketplace. They actually need extraordinary professionals that can measure model capabilities. History. We grew from one to four hundred million in revenue run rate in sixteen months. Fastest ascent in history. Why is this so valuable? The market is bound by the amount of things where humans can do something that models can't. The lab's primary bottleneck to improve models. Is how they can effectively have some way of measuring what success looks like for the model. There's a tweet that you retweeted. If you really think about it, we were put on Earth to create reinforcement learning training data for labs. It's highly likely that the entire economy will become an RL environment machine, building out all of these worlds and context. And I think the narrative in AI. Three years has almost entirely been one of job displacement. But very few companies and people have talked about this new category of jobs that's being created. I talked to a lot of people about what should I be studying, where should I be getting better. How can they leverage this technology to do so much more? We'll give people interviews where we say.

Use whatever tools are available to build a website and let's see what product you're able to build in an hour. Today my guest is Brendan Fudi, CEO and co-founder of Mercor. Mercore is the fastest growing company in history. to go from one to five hundred million dollars in revenue. They did this in seven tін months less than a year and a half.

Brendan is also the youngest unicorn founder ever. They just raised a hundred million dollars at two billion dollar valuation. Mercor, if you haven't heard of them, helps AI labs and AI companies hire experts to help them train their models using AI. They've never had a customer turn, their net retention is over sixteen hundred percent, and they're on a nine figure revenue run rate. In our conversation, we talk about the increasing value and importance of evals.

That is the first couple of minutes. The rest is 1 credit.

We already have this episode, so unlocking it is cheap and permanent: the full transcript, segment and word-level timestamps, and .txt, .srt, .vtt and word-level JSON downloads, as many times as you like, forever.

10 free credits is 10 episodes like this one a month. Episodes nobody has transcribed yet cost their length in hours, because we have to actually transcribe them.