Monitoring Observability

This pulls together the full monitoring stack for production LLM apps: Prometheus metrics with the RED method, Grafana dashboards, and Langfuse v4 tracing with semantic span types and inline scoring. It covers 12 rules across infrastructure monitoring, LLM observability, drift detection, and silent failure detection. The drift detection is smart, using PSI for production scale and dynamic thresholds to cut alert fatigue. What stands out is the opinionated Langfuse-over-LangSmith stance and the focus on catching silent failures like tool skipping and quality degradation. Reach for this when you need to instrument an LLM system properly, not just log requests.

skills.sh installs: 269
GitHub stars: 301
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add yonatangross/orchestkit --skill monitoring-observability --agent claude-code

Installs into .claude/skills of the current project.

Files

Monitoring & Observability

A wrap around Prometheus, Grafana, OpenTelemetry and Langfuse, not a re-teaching of them. This skill carries OrchestKit's delta (version floors, house decisions, scars) and points at the vendor for everything else. Start at references/ork-delta.md.