Observability Ecosystem

Papers

Sigelman, Benjamin H., Luiz André Barroso, Mike Burrows, Pat Stephenson, Manoj Plakal, Donald Beaver, Saul Jaspan, and Chandan Shanbhag. Dapper, a large-scale distributed systems tracing infrastructure, 2010. http://research.google.com/archive/papers/dapper-2010-1.pdf.

Collectors

• Buz serverless, auto-scaling collector that you can deploy and run yourself. ### Buz collects, validates, and delivers schematized data to where it needs to bee.

Sources:

• Event-tracking SDK’s like Snowplow Analytics (Segment and others in development)
• Self-describing payloads
• Webhooks
• Pixels
• Cloudevents

Destinations:

• Databases like Postgres, Mysql, or Clickhouse
• Streaming tech like Pub/Sub, Kinesis, or Redpanda
• Hybrids like Kinesis Firehose
• Message brokers like NATS or RabbitMQ
• Indexes like Elasticsearch or Splunk

Quickstart talks about using redpanda with Buz.

Tracing

OpenTelemetry

Providers

Observability for Distributed Services | Honeycomb; Charity Major, author of many o11y blog posts, and talks works at honeycomb.