MesosCon Europe 2017

Enterprises large and small want to have a disaster recovery plan at the ready when they are running distributed databases. The simplest such setup uses two database clusters in two different data centers with asynchronous replication of all updates. However, already this seemingly simple approach causes considerable head scratching for architects and developers of a distributed data store, considering fault tolerance, network failures, automatic failover and write load spikes.

This talk explains how ArangoDB implements asynchronous DC to DC replication between clusters using the Kafka message broker on both sides together with an incremental replication protocol and automatic write ahead log tailing. Apache Mesos plays a vital role in managing the deployment, managing resources, improve utilization, ensure scalability and ensuring liveness of the whole system.