Observability Llm Obs

This does one thing: it helps Claude answer questions about LLM and agent observability data already living in Elastic. It knows to check both OpenTelemetry traces (where instrumentation like EDOT or OpenLLMetry sends span data with token counts, model names, and call chains) and integration metrics from providers like OpenAI, Bedrock, or Vertex AI. The skill teaches Claude to discover what data streams actually exist before querying, then use ES|QL and Elasticsearch APIs to pull performance, cost, token usage, and agentic workflow details. It explicitly works without Kibana UI and handles the fact that deployments mix ingestion paths. Use this when you need Claude to investigate LLM costs, trace multi-step agent calls, or debug response quality issues from observability data you're already collecting.

GitHub stars: 503
last updated: Jun 1, 2026

View on GitHub

Install

$ npx -y skills add elastic/agent-skills --skill observability-llm-obs --agent claude-code

Installs into .claude/skills of the current project.

Files

LLM and Agentic Observability

Answer questions about monitoring LLMs and agentic components using data actually ingested into Elastic — nothing else. The four questions this skill answers are LLM performance, cost and token utilization, response quality, and call chaining or agentic workflow orchestration.

A given deployment typically uses one or more ingestion paths: APM/OTLP traces, and/or integration metrics and logs. Which one exists is a discovery result, not an assumption — never assume both are present. For ES|QL syntax, commands, and query patterns, use the elasticsearch-esql skill. For service-level latency and error triage that is not LLM-specific, use the observability-sre-triage skill.

Environment Configuration

This skill executes Elasticsearch operations through the elastic CLI. If the elastic CLI is not installed, tell the user what it is needed for. Do not guess credentials, call the HTTP API directly, or attempt other workarounds.

SKILL.md on GitHub

Details

Repository: github.com/elastic/agent-skills
Categories: DevOps & CI/CD, AI & Agent Building
License: Apache-2.0
First seen: Jun 11, 2026