Fallacies of stream processing
10:00 - 10:30, 23rd of May (Thursday) 2024/ DATAMASS STAGE
We all have opinions for everything, including things we have never experienced. Only time and new encounters show whether we were completely, slightly, or not wrong at all. I'm not an exception. I also had some opinions about stream processing with whom I've been working for the past 7 years.
In this talk I'm going to share what were my bad assumptions about stream processing that my first projects corrected brutally. Although it's not specific to one specific technology, you'll see the examples mentioning Apache Spark, AWS, or GCP.
After the session you should better understand what are the traps waiting for you before your first stream processing project, and what are possible solutions.
LEVEL:
Basic
Advanced
Expert
TRACK:
Data Engineering
Data Streaming
TOPICS:
Cloud
Real-Time
Spark
Streaming