Download slides of this talk: https://www.dataengconf.com/speaker/building-highly-reliable-data-pipelines-at-datadog?hsLang=en-us?utm_source=youtube&utm_medium=social&utm_campaign=%20-%20DEC-BCN-18%20Slides%20Download
ABOUT THE TALK:
Every day at Datadog we run massive data pipelines to power core functionality. In this talk, we’ll cover best practices we use at Datadog to ensure that we reliably deliver this functionality while processing trillions of points/day in the face of exponential data growth, hardware failures, corrupt data, and even human error.
ABOUT THE SPEAKER:
Quentin is a Data Engineering Team Lead at Datadog. Over the past 3 years, he has worked with Luigi, Spark, and Go to build and scale many highly reliable data pipelines. These pipelines power numerous internal and customer facing features – including enabling Datadog’s users to perform fast real time queries against PBs of historical time series data.
Related Post:
- DBT: Powerful, Open Source Data Transformations | DataEngConf BCN ’18
- Data Processing with Apache Beam: Towards Portability and Beyond | DataEngConf BCN ’18
- Bytecoin (BCN) highly awaited 20th March event
- RC BATTLE CAR BUILDING CHALLENGE! Building the ULTIMATE Battlebot! – Gmod Garry’s Mod Multiplayer
- Bitcoin Momentum Building | Cardano on Coinbase? | ICE Lists 58 NEW Altcoins on Data Feed
- Reliable Litecoin swings
- Bitcoin Cash 50% OFF, time to load up! This video is the most reliable trading indicator for #BCH!
- CCG Mining Cryptocurrency Cloud Mining Review And Profitability! (Is It A Reliable Good Investment?)
- Joannes Vermorel: Plan ahead to keep Bitcoin Cash network ‘super reliable, super low cost’
- Light Reading at MWC19 – Ultra reliable 5G NR for Industrial IoT
