Blog posts about Kafka

The LinkedIn infrastructure has thousands of services serving millions of queries per second. At this scale, having t...

At LinkedIn, Apache Kafka is used heavily to store all kinds of data, such as member activity, log storage, metrics s...

Learn more about how to migrate your Kafka cluster from one Zookeeper cluster to another without any user impact.

By Benson Ma, Alok Ahuja

Co-authors: Zihan Li, Sudarshan Vasudevan, Lei Sun, and Shirshanka Das Data analytics and AI power many business-crit...

Co-authors: Xiang Zhang and Jingyu Zhu Introduction The Lambda architecture has become a popular architectural style ...

Co-authors: Khai Tran and Steve Weiss Batch and streaming computations are often combined together in the Lambda arch...

By Ben Sykes

As the year draws to a close, we’re taking a look back at ten of our most popular 2019 articles on the LinkedIn Engin...

Co-authors: Krishnan Raman and Joey Salacup Editor's note: This blog has been updated. Monitoring big data pipelines ...

Co-authors: Jon Lee and Wesley Wu Apache Kafka is a core part of our infrastructure at LinkedIn. It was originally de...

The LinkedIn feed relies on a ranked list of the most relevant content for a member. More than 80% of the feed is org...

Editor's note: This blog has been updated. Brooklin—a distributed service for streaming data in near real-time and at...

At LinkedIn, Kafka is the de-facto messaging platform that powers diverse sets of geographically-distributed applicat...

We are pleased to announce today the release of Samza 1.0, a significant milestone in the history of the project. Apa...

How we scaled Spark streaming with a novel balanced Kafka reader for ingesting massive amount of logging events from ...

Co-authors: Vivek Nelamangala and PJ Xiao Introduction to Notifications Social media are computer-mediated platforms ...

Two and a half years ago, the Data Infrastructure SRE team at LinkedIn introduced Burrow, an advanced way to monitor ...