Machine Learning Street Talk (MLST)
Technology
We are now sponsored by Weights and Biases! Please visit our sponsor link: http://wandb.me/MLST
Patreon: https://www.patreon.com/mlst
Yann LeCun thinks that it's specious to say neural network models are interpolating because in high dimensions, everything is extrapolation. Recently Dr. Randall Balestriero, Dr. Jerome Pesente and prof. Yann LeCun released their paper learning in high dimensions always amounts to extrapolation. This discussion has completely changed how we think about neural networks and their behaviour.
[00:00:00] Pre-intro
[00:11:58] Intro Part 1: On linearisation in NNs
[00:28:17] Intro Part 2: On interpolation in NNs
[00:47:45] Intro Part 3: On the curse
[00:48:19] LeCun
[01:40:51] Randall B
YouTube version: https://youtu.be/86ib0sfdFtw
#042 - Pedro Domingos - Ethics and Cancel Culture
#041 - Biologically Plausible Neural Networks - Dr. Simon Stringer
#040 - Adversarial Examples (Dr. Nicholas Carlini, Dr. Wieland Brendel, Florian Tramèr)
#039 - Lena Voita - NLP
#038 - Professor Kenneth Stanley - Why Greatness Cannot Be Planned
#037 - Tour De Bayesian with Connor Tann
#036 - Max Welling: Quantum, Manifolds & Symmetries in ML
#035 Christmas Community Edition!
#034 Eray Özkural- AGI, Simulations & Safety
#033 Prof. Karl Friston - The Free Energy Principle
#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!
#031 WE GOT ACCESS TO GPT-3! (With Gary Marcus, Walid Saba and Connor Leahy)
#030 Multi-Armed Bandits and Pure-Exploration (Wouter M. Koolen)
#029 GPT-3, Prompt Engineering, Trading, AI Alignment, Intelligence
NLP is not NLU and GPT-3 - Walid Saba
AI Alignment & AGI Fire Alarm - Connor Leahy
Kaggle, ML Community / Engineering (Sanyam Bhutani)
Sara Hooker - The Hardware Lottery, Sparsity and Fairness
The Social Dilemma Part 3 - Dr. Rebecca Roache
The Social Dilemma - Part 2
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
Lex Fridman Podcast
Elliot in the Morning