How Apache Kafka got faster by switching ext4 to XFS
2024-04-29
Download
Right click and do "save link as"
https://oscourse.win
Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion.
0:00 Intro
0:30 Summary
2:35 How Kafka Works?
5:00 Producers Writes are Slow
7:10 Tracing Kafka Protocol
12:00 Tracing Kernel System Calls
16:00 Journaled File Systems
21:00 Improving ext4
26:00 Switching to XFS
Blog
https://blog.allegro.tech/2024/03/kafka-performance-analysis.html
More Episodes
Six stages of a good software engineer
2024-11-01
2024-11-01
MySQL is having a bumpy journey
2024-09-28
2024-09-28
When do you use threads?
2024-09-13
2024-09-13
Frontend and Backends Timeouts
2024-09-07
2024-09-07
Postgres is combining IO in version 17
2024-09-02
2024-09-02
Windows vs Linux Kernel
2024-08-30
2024-08-30
Running out of TCP ephemeral source ports
2024-08-25
2024-08-25
io uring gets even faster
2024-05-20
2024-05-20
Database Torn pages
2024-02-29
2024-02-29
The Internals of MongoDB
2024-02-19
2024-02-19
The Beauty of Programming Languages
2024-02-19
2024-02-19
The Danger of Defaults - A PostgreSQL Story
2024-02-18
2024-02-18
Database Background writing
2024-02-16
2024-02-16
Get this podcast on your
phone, FREE
