Scuba: Real-time monitoring and log analytics at scale

Harani Mukkala, Software Engineer, Facebook Stavros Harizopoulos, Software Engineer, Facebook Scuba is Facebook’s platform for real-time ingestion, processing, storing, and querying of structured logs from the entire fleet of machines. Scuba makes data available for querying in less than a minute and uses a massive fanout architecture to provide query results in less than a second. Harani and Stavros discuss the monitoring, debugging, and ad-hoc analytic use cases that are enabled by Scuba’s log-everything approach. They go into further detail about the system’s architecture and the set of trade-offs they’ve had to make to scale the platform. They conclude their discussion with plans for the future and the central role they envision Scuba playing in Facebook’s observability infrastructure.