Podcast Archives - Software Engineering Daily
News:Tech News
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops.
Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting larger, but the smallest models that are commercially relevant are getting smaller. The company was started in 2023 and has raised money from General Catalyst and other industry leaders.
Atila Orhon is the founder of Argmax and he previously worked at Apple and NVIDIA. He joins the show to talk about working in computer vision, building ML tooling at Apple, optimizing ML models, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
Building Chess.com with Jay Severson
Mastodon with Eugen Rochko
Vercel AI with Lee Robinson
Blender with Sybren Stüvel
Netflix UIs at Scale with Shaundai Person
Algolia with Sean Mullaney
OpsHelm with Kyle McCullough
JetBrains AI with Jodie Burchell
AWS re:Invent Special: PartyRock Generative AI Apps with Mike Miller
AWS re:Invent Special: The AWS Cloud Institute with Kevin Kelly
AWS re:Invent Special: CircleCI with Rob Zuber
AWS re:Invent Special: Sagemaker with Ankur Mehrotra
Bonus Episode: Hypnospace Outlaw with Jay Tholen
CockroachDB with Jordan Lewis
Apiiro Security Posture Management with Yonatan Eldar
Pinecone Vector Database with Marek Galovic
Bonus Episode: Adobe Cloud Native with Carlos Sanchez
Rama with Nathan Marz
Kubefirst with Frédéric Harper
Vespa.ai with Jon Bratseth
Create your
podcast in
minutes
It is Free
Cyber Security Headlines
The WAN Show
The 404 Media Podcast
Cybersecurity Today
Techmeme Ride Home