Observability Ecosystem

Papers

Dapper, a Large-Scale Distributed Systems Tracing Infrastructure (Sigelman et al., 2010)

Collectors

• Buz serverless, auto-scaling collector that you can deploy and run yourself. Buz collects, validates, and delivers schematized data to where it needs to bee.

Sources:

• Event-tracking SDK’s like Snowplow Analytics (Segment and others in development)
• Self-describing payloads
• Webhooks
• Pixels
• Cloudevents

Destinations:

• Databases like Postgres, Mysql, or Clickhouse
• Streaming tech like Pub/Sub, Kinesis, or Redpanda
• Hybrids like Kinesis Firehose
• Message brokers like NATS or RabbitMQ
• Indexes like Elasticsearch or Splunk

Quickstart talks about using redpanda with Buz.

Tracing

OpenTelemetry

Providers

Observability for Distributed Services | Honeycomb; Charity Major, author of many o11y blog posts, and talks works at honeycomb.

Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., & Shanbhag, C. (2010). Dapper, a Large-Scale Distributed Systems Tracing Infrastructure [Techreport]. Google, Inc. http://research.google.com/archive/papers/dapper-2010-1.pdf