Blog posts about Big Data

In this blog post we present a way to version your Airflow DAGs on a single server through isolated pipeline and... ...

By Vikram Srivastava and Marcelo Mayworm

As part of our “Data Engineers of Netflix” series, Pallavi Phadnis shares her journey to Data Engineering at Netflix.

This post is part of our “Data Engineers of Netflix” series, where our very own data engineers talk about their journ...

By Alok Tiagi, Hariharan Ananthakrishnan, Ivan Porto Carrero and Keerti Lakshminarayan

Data Engineers of Netflix — Interview with Samuel Setegne Netflix Technology Blog Follow Apr 26, 2021 · 5 min read Sa...

This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about t...

Co-authors: Chris Li, Kevin Lau, and Subbu Sanka Editor’s Note: Recently, the Apache Software Foundation (ASF) announ...

By Anupom Syam

By Hariharan Ananthakrishnan and Angela Ho

Realtime and batch analytics at Airbnb and the role Druid plays in our analytics system architecture

Apache’s lightning fast engine for data analysis and machine learning ...

Solving the many small files problem for AVRO ...

Over the last two years at LinkedIn, I’ve been working on a distributed key-value database called “Venice.” Venice is...

Editor's note: This blog has been updated. Typical distributed data systems are clusters composed of a set of machine...

We look at the design, implementation, and generation of complex events. ...

What is the shape of your big data? While we do love to talk about the size of our big data—terabytes, petabytes, and...

Training models using larger amounts of data for a great Zalando Hack Week project. ...