Instrumenting With Mlflow Tracing
Sets up MLflow tracing for Python and TypeScript agents and LLM apps, with autoinstrumentation for LangChain, LangGraph, OpenAI, and other frameworks. The guide tells you what's actually worth tracing (LLM calls, retrieval, tool use) versus what adds noise (string formatting, config loading), which is more helpful than most observability docs. Includes verification steps to confirm traces are actually being logged before you waste time on evaluation, plus patterns for feedback collection and production deployment with sampling. Load this before running agent evaluation or you'll be debugging blind.
- skills.sh installs
- 1.1K
- GitHub stars
- 91
- last updated
- Aug 21, 2026
Install
$ npx -y skills add mlflow/skills --skill instrumenting-with-mlflow-tracing --agent claude-codeInstalls into .claude/skills of the current project.
Files
Sets up MLflow tracing for Python and TypeScript agents and LLM apps, with autoinstrumentation for LangChain, LangGraph, OpenAI, and other frameworks. The guide tells you what's actually worth tracing (LLM calls, retrieval, tool use) versus what adds noise (string formatting, config loading), which is more helpful than most observability docs. Includes verification steps to confirm traces are actually being logged before you waste time on evaluation, plus patterns for feedback collection and production deployment with sampling. Load this before running agent evaluation or you'll be debugging blind.
Browse the repository on GitHubSponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/mlflow/skills
- Categories
- DevOps & CI/CD, AI & Agent Building, Automation & Workflows, Python
- First seen
- Jun 3, 2026
More from mlflow/skills
All 8Recommended
More DevOps & CI/CD
frontend-designdigitalsamba/claude-code-video-toolkitCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applicat1.1Kskills.sh installs
strategy-documentjezweb/claude-skillsWrite structured strategic documents for small and medium businesses: SWOT analyses, lean business plans, OKRs, competitive analyses. Each mode has a defined st1.1Kskills.sh installs
custom-product-pageseronred/aso-skillsWhen the user wants to design, deploy, or measure Apple Custom Product Pages (CPP) — the alternate App Store product pages with different screenshots, preview v1.1Kskills.sh installs
stock-watcheragentbay-ai/agentbay-skillsManage and monitor a personal stock watchlist with support for adding, removing, listing stocks, and summarizing their recent performance using data from 10jqka1.1Kskills.sh installs
phoenix-evalsgithub/awesome-copilotBuild and run evaluators for AI/LLM applications using Phoenix.1Kskills.sh installsphoenix-tracinggithub/awesome-copilotOpenInference semantic conventions and instrumentation for Phoenix AI observability. Use when implementing LLM tracing, creating custom spans, or deploying to p1Kskills.sh installs