BACK

Journey to the cloud, or how we started building it ourselves

14:30 - 15:00, 22nd of May (Wednesday) 2024/ DATAMASS STAGE

From buying off-the-shelves monoliths to eventually becoming the modern enterprise, that knows how to build software - that's our story!
 
After the acquisition of Multimedia, we had to learn how to process data at a much larger scale (4x growth) without spending millions, how to build software and release multiple times a day instead of once a quarter to meet rapidly changing customer expectations, and growing costs of running business.
 
During this talk, we will present how to take advantage of managed services available in the public cloud to reduce toil drastically. We will cover analytics based on BigQuery/Spark which allows us to process billions of records from end-user devices (28bln in 6 seconds!) as well as day-to-day reporting. Finally, we will share lessons learned on how it all impacted our development culture and how we could finally deploy over 80 times in a single sprint, run 10s of autoscaling services, process petabytes of data, and simply have fun.

LEVEL:
Basic Advanced Expert
TRACK:
Cloud Data Engineering DevOps
TOPICS:
Architecture DevOps Spark