Monitoring

Monitor Lumina services in production.

Prometheus Metrics

Lumina exports Prometheus metrics:

scrape_configs:
  - job_name: 'lumina-ingestion'
    static_configs:
      - targets: ['ingestion:9090']

  - job_name: 'lumina-api'
    static_configs:
      - targets: ['api:9090']

Key Metrics

Ingestion:

lumina_traces_ingested_total
lumina_traces_ingested_errors_total
lumina_ingestion_duration_seconds

API:

lumina_api_requests_total
lumina_api_request_duration_seconds
lumina_database_query_duration_seconds

Worker:

lumina_traces_processed_total
lumina_worker_queue_depth
lumina_worker_processing_duration_seconds

Grafana Dashboard

Import pre-built dashboard:

kubectl apply -f https://charts.uselumina.io/grafana/dashboard.json

Alerting

Configure Prometheus alerts:

groups:
  - name: lumina
    rules:
      - alert: HighIngestionErrors
        expr: rate(lumina_traces_ingested_errors_total[5m]) > 100
        labels:
          severity: warning

      - alert: HighQueueDepth
        expr: lumina_worker_queue_depth > 10000
        labels:
          severity: critical

Getting Started

Production

Monitoring

Prometheus Metrics

Key Metrics

Grafana Dashboard

Alerting

​Prometheus Metrics

​Key Metrics

​Grafana Dashboard

​Alerting

Prometheus Metrics

Key Metrics

Grafana Dashboard

Alerting