What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge?
The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss.
We get into:
Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71
Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899
The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence.
Learn more about your ad choices. Visit megaphone.fm/adchoices
Adam Tooze and Matt Klein Return!
Clubhouse and Feminism in China with Shen Lu
故事FM (China's "This American Life") Founder Talks Storytelling in Modern China
Beyond Espionage: China's Quest for Foreign Technology
Rethinking Industrial Policy...and Everything Else
Chinese Cooking Demystified
Richard Fontaine on CNAS and US-China
Taiwan! Pigs, Politics, and Pop Music
A User's Guide to US Industrial Policy
WWII's Legacy in China with Rana Mitter
China's Spies
Great Power Competition with Richard Danzig
DIU's Michael Brown on US-China Tech Competition
KFC, The Toilet Revolution, and the Business of Propaganda
Chinese Hip Hop in 2020 Radio Show
America's New Tools of Coercion
Wendy Cutler on US-China Trade Policy
Blockchain Chicken Farm: How Tech Changed Rural China
How to Research China, Talent Programs, and Military-Civil Fusion
The Blunder Down Under? How China-Australia Relations Fell Off a Cliff
Create your
podcast in
minutes
It is Free