While centralized logging previously existed at Twitter, it was limited by low ingestion capacity and limited query c...
August 13, 2021
Twitter Engineering usually posts about infrastructure, data, cortex, scale, ai/ml, ml, analytics, data visualizations, realtime, and key-value.
While centralized logging previously existed at Twitter, it was limited by low ingestion capacity and limited query c...
August 13, 2021
While centralized logging previously existed at Twitter, it was limited by low ingestion capacity and limited query c...
August 13, 2021
Today we announced the launch of the new Twitter.com – a project years in the making. Now, we want to go behind the s...
July 15, 2019
While centralized logging previously existed at Twitter, it was limited by low ingestion capacity and limited query c...
August 13, 2021
Today we announced the launch of the new Twitter.com – a project years in the making. Now, we want to go behind the s...
July 15, 2019
At Twitter, we process approximately 400 billion events in real time and generate petabyte (PB) scale data every day....
October 22, 2021
While centralized logging previously existed at Twitter, it was limited by low ingestion capacity and limited query c...
August 13, 2021
Today we announced the launch of the new Twitter.com – a project years in the making. Now, we want to go behind the s...
July 15, 2019
At Twitter, we process approximately 400 billion events in real time and generate petabyte (PB) scale data every day....
October 22, 2021
In October 2020, we heard feedback from people on Twitter that our image cropping algorithm didn’t serve all people e...
At Twitter, our on premise data centers contain hundreds of thousands of hardware servers and millions of server hard...
January 6, 2023
Twitter customers are significantly affected by network latency – the higher the latency, the less ideal the experien...
October 21, 2022
The Search Infrastructure team’s goal is to provide a low-friction, self-service platform that simplifies and acceler...
October 14, 2022
Twitter ingests thousands of datasets daily through our automated framework. It runs on top of existing services such...
September 15, 2022
When the engineers on Twitter’s platform teams come into work every day, whether they’re sitting at one of the desks ...
June 28, 2022
Over-squashing is a common plight of Graph Neural Networks occurring when message passing fails to propagate informat...
In 2020, we tested prompts that encouraged people to pause and reconsider a potentially harmful or offensive reply be...
June 9, 2022
Twitter has been serving the public conversation for over 15 years. In those 15 years, much has changed from a techno...
May 17, 2022
Druid at Twitter An important characteristic of Twitter is its real-time nature. Consequently, many of Twitter’s pro...
May 13, 2022
On the Conversations Data Science team at Twitter, a piece of our job is understanding how conversations are happenin...
May 3, 2022
Graphs are a core asset at Twitter, describing how users interact with each other through Follows, Tweets, Topics, an...
Introduction Manhattan is Twitter’s internally-developed distributed key-value store. It’s the default storage solut...
February 28, 2022
At Twitter, we process approximately 400 billion events in real time and generate petabyte (PB) scale data every day...
February 10, 2022
We are introducing a new library for iOS, macOS, and Linux for ApacheThrift using Swift Codable. This new Thrift Libr...
February 4, 2022
As part of our commitment to responsible machine learning (ML), we’re continuously looking for opportunities to advan...
Background People come to Twitter with the intention of staying informed on what’s happening within their world of i...
It’s important that people can easily find and connect with the content and conversations they’re interested in when ...
January 18, 2022
Introduction Within Cortex Platform (Twitter’s ML Platform group), the Experimentation Tools (ET) team is chartered ...
December 30, 2021