The concept of literate programming, or the idea of programming in a document, was first introduced in 1984 by Donald Knuth. And as of today, notebooks are now the defacto tool for doing data science work. So as the data tooling space continues to evolve at breakneck speed, what are the possible directions the data science notebook can take?
In this episode of DataFramed, we talk with Dr. Jodie Burchell, Data Science Developer Advocate at JetBrains, to find out how data science notebooks evolved into what they are today, what her predictions are for the future of notebooks and data science, and how generative AI will impact data teams going forward.
Jodie completed a Ph.D. in clinical psychology and a postdoc in biostatistics before transitioning into data science. She has since worked for 7 years as a data scientist, developing products ranging from recommendation systems to audience profiling. She is also a prolific content creator in the data science community.
Throughout the episode, Jodie discusses the evolution of data science notebooks over the last few years, noting how the move to remote-based notebooks has allowed for the seamless development of more complex models straight from the notebook environment.
Jodie and Adel’s conversation also covers tooling challenges that have led to modern IDEs and notebooks, with Jodie highlighting the importance of good database tooling and visibility. She shares how data science notebooks have evolved to help democratize data for the wider organization, the tradeoffs between engineering-led approaches to tooling compared to data science approaches, what generative AI means for the data profession, her predictions for data science, and more.
Tune in to this episode to learn more about the evolution of data science notebooks and the challenges and opportunities facing the data science community today.
Links to mentioned in the show:
More on the topic:
#250 How Data and AI are Changing Data Management with Jamie Lerner, CEO, President & Chairman at Quantum
#249 Towards Self-Service Data Engineering with Taylor Brown, Co-Founder and COO at Fivetran
#248 Effective Product Management for AI with Marily Nika, Gen AI Product Lead at Google Assistant
#247 Aligning AI with Enterprise Strategy with Leon Gordon, CEO at Onyx Data
#246 AI and the Future of Art with Kent Keirsey, Founder & CEO at Invoke
#245 Can We Make Generative AI Cheaper? With Natalia Vassilieva, Senior VP & Field CTO & Andy Hock, VP, Product & Strategy at Cerebras Systems
#244 Using Data to Optimize Costs in Healthcare with Travis Dalton and Jocelyn Jiang President/CEO & VP of Data & Decision Science at MultiPlan
#243 No-Code LLMs In Practice with Birago Jones & Karthik Dinakar, CEO & CTO at Pienso
#242 Data Storytelling for Kids with Cole Nussbaumer Knaflic, Founder and CEO of Storytelling with Data
#241 Getting Generative AI Into Production with Lin Qiao, CEO and Co-Founder of Fireworks AI
#240 Generative AI in the Enterprise with Steve Holden, Senior Vice President and Head of Single-Family Analytics at Fannie Mae
#239 New Models for Digital Transformation with Alison McCauley Chief Advocacy Officer at Think with AI & Founder of Unblocked Future
#238 Data & AI for Improving Patient Outcomes with Terry Myerson, CEO at Truveta
#237 Guardrails for the Future of AI with Viktor Mayer-Schönberger, Professor of Internet Governance and Regulation at the University of Oxford
#236 Optimizing Sales Using AI with Ellie Fields, CPEO at Salesloft
#235 Developing Generative AI Applications with Dmitry Shapiro, CEO of MindStudio
#234 High Performance Generative AI Applications with Ram Sriharsha, CTO at Pinecone
#233 Generative AI at EY with John Thompson, Head of AI at EY
#232 How are Businesses Really Using AI? With Tathagat Varma, Global TechOps Leader at Walmart Global Tech
#231 Manage Your Data Better with Shinji Kim, CEO at Select Star
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
Lex Fridman Podcast
All-In with Chamath, Jason, Sacks & Friedberg