Download slides of this talk: https://www.dataengconf.com/speaker/data-processing-with-apache-beam-towards-portability-and-beyond?utm_source=youtube&utm_medium=social&utm_campaign=%20-%20DEC-BCN-18%20Slides%20Download
ABOUT THE TALK:
Apache Beam is a unified batch and streaming programming model for distributed data processing. Unlike other systems, Beam supports a range of different execution engines, e.g. Apache Flink, Apache Spark, or Google Cloud Dataflow.
But it doesn’t stop there. The Beam API is not only available in Java, but you can also write your data processing jobs in Python or Go. This gives you much greater flexibility compared to other data processing APIs. You can finally leverage the features and libraries of your favorite programming language.
In this talk, I would like to give an introduction to the Beam programming model and explain how Beam achieves portability for different languages and execution engines.
ABOUT THE SPEAKER:
Max is a software engineer and PMC member of Apache Flink and Apache Beam. During his studies at Free University of Berlin and Istanbul University, he worked at Zuse Institute Berlin on Scalaris, a distributed transactional database. Inspired by the principles of distributed systems and open-source, he helped to develop Apache Flink at dataArtisans and, in the course of, joined the Apache Beam community. After maintaining the SQL layer of the distributed database CrateDB, he is now working on the cross-language portability aspects of Apache Beam.
Related Post:
- DBT: Powerful, Open Source Data Transformations | DataEngConf BCN ’18
- Building highly reliable data pipelines at Datadog | DataEngConf BCN ’18
- IBM Db2 Warehouse: Stream IoT data with Apache Kafka
- IoT and Data API-Sending Sensor Data to FileMaker Server from a Raspberry Pi [ITG 03]
- Enduro Trujillo, Honduras. Tornado 250, génesis xm 200, yamaha xtz 125 apache 160 génesis 125
- NOAH TERBARU | Ada Apa Denganmu | Apache Feel The BLACKGOLD Concert – CIREBON 14 Oktober 2017
- NOAH TERBARU | Ada Apa Denganmu | Apache Feel The BLACKGOLD Concert | LAMPUNG 18 November 2017
- NOAH TERBARU | Ada Apa Denganmu | Apache Feel THE BLACKGOLD Concert – Kendal 12 Agustus 2017
- #ACEU19: Paul Brebner – Kongo: Building a Scalable Streaming IoT Application using Apache Kafka
- NOAH TERBARU | Ada Apa Denganmu | Apache Feel The BLACKGOLD Concert – MANADO 2017 #NOAH #ARIEL