Observability Ecosystem

Papers

Dapper, a Large-Scale Distributed Systems Tracing Infrastructure (Sigelman et al. 2010)

Collectors

• Buz serverless, auto-scaling collector that you can deploy and run yourself. Buz collects, validates, and delivers schematized data to where it needs to bee.

Sources:

• Event-tracking SDK's like Snowplow Analytics (Segment and others in development)
• Self-describing payloads
• Webhooks
• Pixels
• Cloudevents

Destinations:

• Databases like Postgres, Mysql, or Clickhouse
• Streaming tech like Pub/Sub, Kinesis, or Redpanda
• Hybrids like Kinesis Firehose
• Message brokers like NATS or RabbitMQ
• Indexes like Elasticsearch or Splunk

Quickstart talks about using redpanda with Buz.

Tracing

OpenTelemetry

Providers

Observability for Distributed Services | Honeycomb; Charity Major, author of many o11y blog posts, and talks works at honeycomb.

References

• Sigelman, Barroso, Burrows, Stephenson, Plakal, Beaver, Jaspan, Shanbhag (2010). Dapper, a Large-Scale Distributed Systems Tracing Infrastructure.