Co-authors: Steven Chuang, Qinyu Yue, Aravind Rao, and Srihari Duddukuru Introduction Having recently transitioned Li...
Blog posts about Hadoop
43 post(s)
Newest
Co-authors: Keqiu Hu, Jonathan Hung, Haibo Chen, and Sriram Rao At LinkedIn, we use Hadoop as our backbone for big da...
September 8, 2021
Co-authors: Keqiu Hu, Jonathan Hung, and Junfan Zhang Today, TonY is joining the LF AI & Data Foundation, an umbrella...
July 15, 2021
Co-authors: Konstantin V. Shvachko, Chen Liang, and Simbarashe Dzinamarira LinkedIn runs its big data analytics on Ha...
May 27, 2021
Co-authors: Zihan Li, Sudarshan Vasudevan, Lei Sun, and Shirshanka Das Data analytics and AI power many business-crit...
Co-authors: Sandhya Ramu and Vasanth Rajamani For companies and organizations, failure tends to be far more illuminat...
August 6, 2020
Co-authors: Cong Gu, Abin Shahab, Chen Qiang, and Keqiu Hu Editor's note: This blog has been updated. LinkedIn AI has...
June 10, 2020
One of the most common ways to store results from a Spark job is by writing the results to a Hive table stored on HDF...
March 3, 2020
Co-authors: Christian Mathiesen and Jie Zhang Your LinkedIn profile is intended to be a representative picture of you...
September 17, 2019
Recently, Twitter Engineering embarked on an effort to migrate elements of the Twitter stack to the cloud. This is an...
May 9, 2019
Recently, Twitter Engineering embarked on an effort to migrate elements of the Twitter stack to the cloud. This artic...
April 8, 2019
On January 30, Hadoop developers gathered at LinkedIn’s offices in Mountain View to share their latest work, with pre...
February 21, 2019
Co-authors: Jonathan Hung, Keqiu Hu, and Anthony Hsu LinkedIn heavily relies on artificial intelligence to deliver co...
September 12, 2018
Apache’s lightning fast engine for data analysis and machine learning ...
Co-authors: Erik Krogen and Min Shen In March 2015, LinkedIn’s Big Data Platform team experienced a crisis. As the te...
February 8, 2018
Solving the many small files problem for AVRO ...
Co-authors: Carl Steinbach and Vasanth Rajamani Big challenges in the big data ecosystem At LinkedIn, we have a numbe...
Next Tuesday marks the start of the Spark Summit Conference in San Francisco. This year, LinkedIn engineers and data ...