Technology
Procella: YouTube's super-system for analytics data storage
2020-07-06
Download
Right click and do "save link as"
This is a re-release of an episode that originally ran in October 2019.
If you’re trying to manage a project that serves up analytics data for a few very distinct uses, you’d be wise to consider having custom solutions for each use case that are optimized for the needs and constraints of that use cases. You also wouldn’t be YouTube, which found themselves with this problem (gigantic data needs and several very different use cases of what they needed to do with that data) and went a different way: they built one analytics data system to serve them all. Procella, the system they built, is the topic of our episode today: by deconstructing the system, we dig into the four motivating uses of this system, the complexity they had to introduce to service all four uses simultaneously, and the impressive engineering that has to go into building something that “just works.”
view more
More Episodes
Rock the ROC Curve
2017-01-30
2
2017-01-30
2
Ensemble Algorithms
2017-01-23
8
2017-01-23
8
How to evaluate a translation: BLEU scores
2017-01-16
1
2017-01-16
1
Zero Shot Translation
2017-01-09
2017-01-09
Google Neural Machine Translation
2017-01-02
2017-01-02
How to Lose at Kaggle
2016-12-12
2
2016-12-12
2
Attacking Discrimination in Machine Learning
2016-12-05
1
2016-12-05
1
Recurrent Neural Nets
2016-11-28
7
2016-11-28
7
Neural Net Cryptography
2016-11-14
2016-11-14
Deep Blue
2016-11-07
2016-11-07
Organizing Google's Datasets
2016-10-31
2016-10-31
Fighting Cancer with Data Science: Followup
2016-10-24
7
2016-10-24
7
The 19-year-old determining the US election
2016-10-17
2
2016-10-17
2
How to Steal a Model
2016-10-09
2
2016-10-09
2
Regularization
2016-10-03
2016-10-03
The Cold Start Problem
2016-09-26
2
2016-09-26
2
Open Source Software for Data Science
2016-09-19
3
2016-09-19
3
Get this podcast on your
phone, FREE
