Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel
Listen to the original audio · Transcribed with NVIDIA Parakeet · Why times can differ in your player
If you've ever wondered how generative AI works and where the technology is heading, this episode is for you. We're going to explain the basics of the technology and then catch up with modern-day advances like reasoning to help you understand exactly how it does what it does and where it might advance in the future. That's coming up with semi-analysis founder and chief analyst Dylan Patel right after this. It's never been more challenging to get frontier compute. How do you know where to look, who to trust, or how much to pay?
Akash is an open cloud that provides easy access, flexibility, and peace of mind. That's how companies like Razor were able to cut their inference cost by 15 times. Visit Akash.network slash Alex for a free consultation. That's Akash.network slash Alex for a free consultation. Welcome to Big Technology Podcast, a show for cool-headed and nuanced conversation of the tech world and beyond.
We're joined today by semi-analysis founder and chief analyst Dylan Patel, a leading expert in semiconductor and generative AI research and someone I've been looking forward to speaking with for a long time. Now, I want this to be an episode that A helps people learn how generative AI works and B, is an episode that people will send to their friends to explain. to them how generative AI works. I've had a couple of those that I've been sending to my friends and colleagues and counterparts about what is going on within generative AI. That includes one, this three and a half hour long video from Andre Kirpathy explaining everything about training large language models.
We already have this episode, so unlocking it is cheap and permanent: the full transcript (40 minutes, 8,150 words), segment and word-level timestamps, and .txt, .srt, .vtt and word-level JSON downloads, as many times as you like, forever.
No account needed, we create one from your checkout email. With credits it is 1 credit; packs start at 5 episodes for $3.49, and monthly plans are cheaper still.