System design: Building Scalable Caching Systems via McRouter - @Scale 2014 - Data

 Here is the link. 

Rajesh Nishtala, Engineer at Facebook and Ricky Ramirez, Engineer at Reddit Modern large scale web infrastructures rely heavily on distributed caching (e.g memcached) to process user requests. The problems that McRouter addresses are not specific to Facebook, but distributed caching systems in general. As a result, Instagram and Reddit have also adopted McRouter as the primary communication layer to their cache tiers.

Consistent hashing

Connection pooling

Server poolsAutomatic failover

cold cache warmup

Broadcast operations

Replicated data sets

Shadow production traffic

Composable routing