Introduction Apache Kafka is an open-sourced event streaming platform where users can create Kafka topics as data tra...
November 29, 2022
Introduction Apache Kafka is an open-sourced event streaming platform where users can create Kafka topics as data tra...
November 29, 2022
The LinkedIn infrastructure has thousands of services serving millions of queries per second. At this scale, having t...
At LinkedIn, Apache Kafka is used heavily to store all kinds of data, such as member activity, log storage, metrics s...
April 11, 2022
Learn more about how to migrate your Kafka cluster from one Zookeeper cluster to another without any user impact.
October 12, 2021
By Benson Ma, Alok Ahuja
August 30, 2021
Co-authors: Zihan Li, Sudarshan Vasudevan, Lei Sun, and Shirshanka Das Data analytics and AI power many business-crit...
Co-authors: Xiang Zhang and Jingyu Zhu Introduction The Lambda architecture has become a popular architectural style ...
December 1, 2020
Co-authors: Khai Tran and Steve Weiss Batch and streaming computations are often combined together in the Lambda arch...
By Ben Sykes
March 3, 2020
As the year draws to a close, we’re taking a look back at ten of our most popular 2019 articles on the LinkedIn Engin...
Co-authors: Krishnan Raman and Joey Salacup Editor's note: This blog has been updated. Monitoring big data pipelines ...
October 30, 2019
Co-authors: Jon Lee and Wesley Wu Apache Kafka is a core part of our infrastructure at LinkedIn. It was originally de...
October 8, 2019
The LinkedIn feed relies on a ranked list of the most relevant content for a member. More than 80% of the feed is org...
August 27, 2019
Editor's note: This blog has been updated. Brooklin—a distributed service for streaming data in near real-time and at...
At LinkedIn, Kafka is the de-facto messaging platform that powers diverse sets of geographically-distributed applicat...
February 7, 2019
We are pleased to announce today the release of Samza 1.0, a significant milestone in the history of the project. Apa...
November 27, 2018
How we scaled Spark streaming with a novel balanced Kafka reader for ingesting massive amount of logging events from ...
November 20, 2018
Co-authors: Vivek Nelamangala and PJ Xiao Introduction to Notifications Social media are computer-mediated platforms ...