Coffee & Systems - Week#3 (It’s logs all the way down…)
The concept is simple, we pick a list of articles/talks to discuss in a random cafe. The overall aim is to build a community of folks motivated to learn more about systems.
Reading Material(s)
We're back after a long hiatus! I hope everyone had a good holiday and is feeling recharged 🙂
For Week #3, we're returning to basics and discussing logs. As Jay Kreps eloquently puts it: "A log is perhaps the simplest possible storage abstraction. It is an append-only, totally-ordered sequence of records ordered by time."
We'll kick things off by delving into "I ♥ Logs," which details Jay's thoughts on the importance of logs as the backbone of distributed data systems. Next, we'll explore how data is organized in Kafka, bridging the gap between theory and practice. Finally, we'll wrap up with a brief look at how to build queues on logs (KIP-932)
Deep dive into Apache Kafka storage internals: segments, rolling and retention
[Optional] The advantages of queues on logs
Some ground rules
The discussion material will be posted in advance and folks are expected to pre-read
Usually, a single person will drive the initial discussion(pre-decided) summarising the material, post this we can all deep-dive into healthy discussions on the same
This is not a place to discuss interview questions (design YouTube/Instagram/Twitter/Google Docs from scratch…)
The topics should be intermediate level (goldilocks principle - not so hard that folks have a hard time following, not so easy that folks are bored)
There is no fixed schedule for the learning group. We might have this every fortnight/every month or might do this weekly (depending on interest)