In this tech talk, we discuss several options for performing real-time extract, transform, and load (ETL) using Amazon Kinesis, AWS Lambda, AWS Glue, and Amazon S3. We will provide an overview of two different options with distinct advantages for building real-time ETL applications prior to loading a data lake. Our customer, John Deere, will describe how they extract IoT sensor measurements from sophisticated agricultural equipment, transform them into useful customer information in real-time, and load the transformed data into their data lake. They will cover how they use different services for their solution depending on the use case and then dive deep into one example.
Learning Objectives:
– Learn how to decide between what processing to do in real-time and what to do in batch
– Learn how to perform real-time ETL using Amazon Kinesis Data Firehose, AWS Lambda, and AWS Glue, compared to Amazon Kinesis Data Streams and Amazon Kinesis Data Analytics
– Learn the pros and cons of the two solutions, and how knowledgeable AWS customers make the decision about how to use one over the other
Related Post:
- Top IoT Projects 2023 | Useful IoT Devices | Smart IoT Projects | IoT Applications | Simplilearn
- Top IoT Projects 2023 | Useful IoT Devices | Smart IoT Projects | IoT Applications | Simplilearn
- Real Time Inference at the Edge with FogHorn, Amazon IoT & Amazon Sagemaker
- Ledger Wallet Customer Data Exposed on RaidForums! Is Your Crypto Safe?
- Sell Your Data! – Earn CryptoCurrency Selling Data! – Marketplace for the IoT! – DataBroker DAO
- HOW TO PERFORM REAL TECHNICAL ANALYSIS IN YOUR TRADING **FOREX-CRYPTOCURRENCY-STOCKS**
- IoT: Gigantic Network of Connected Devices | IoT Tutorial | IoT Internet of Things | Edureka
- IoT Devices Example | IoT Applications | Internet of Things Tutorial | IoT Training | Edureka
- Build security into new IoT devices with Azure Sphere
- Intel Coffee Lake CPUs Leaked on Amazon | Google Bans Cryptocurrency Ads
