In this workshop, participants will build their own microservice application and connect it to a Fast Data Pipeline consisting of Apache Spark, Mesos, Cassandra, and Kafka. They will then deploy this pipeline on top of DC/OS, and explore the operational aspects of updating, scaling, and monitoring the data pipeline.
Participants will learn about:
Best practices for setting up Fast Data Pipelines
The components of the SMACK stack and respective alternatives.
E.g., using Apache Flink for stream processing
How to deploy such stack in an efficient and fault-tolerant way
How to operate and monitor the stack once it is set up:
Monitoring
Upgrades
Debugging
