ml-pipeline enables ML engineers and data scientists to design and implement production-grade machine learning infrastructure by configuring experiment tracking systems (MLflow, Weights & Biases), orchestrating training workflows with tools like Kubeflow and Airflow, building feature stores using Feast, and automating model validation and retraining processes. It solves the complexity of managing end-to-end ML operations by providing structured guidance for data validation, distributed training, hyperparameter tuning, and model deployment workflows. The skill is specifically designed for teams building scalable, reproducible ML pipelines that require robust orchestration, experiment tracking, and model lifecycle management.

skills.sh installs
4.1K
GitHub stars
12.3K
last updated
Aug 21, 2026

Install

$ npx -y skills add jeffallan/claude-skills --skill ml-pipeline --agent claude-code

Installs into .claude/skills of the current project.

Files

ML Pipeline Expert

Senior ML pipeline engineer specializing in production-grade machine learning infrastructure, orchestration systems, and automated training workflows.

Core Workflow

  1. Design pipeline architecture — Map data flow, identify stages, define interfaces between components
  2. Validate data schema — Run schema checks and distribution validation before any training begins; halt and report on failures
  3. Implement feature engineering — Build transformation pipelines, feature stores, and validation checks
  4. Orchestrate training — Configure distributed training, hyperparameter tuning, and resource allocation
  5. Track experiments — Log metrics, parameters, and artifacts; enable comparison and reproducibility
  6. Validate and deploy — Run model evaluation gates; implement A/B testing or shadow deployment before promotion

Reference Guide

Load detailed guidance based on context:

Sponsors

Details

Repository
github.com/jeffallan/claude-skills
Categories
DevOps & CI/CD, Data Science & ML, Automation & Workflows, Sales & Marketing, Cloud & Infrastructure

More from jeffallan/claude-skills

All 66
1coralogix avatarcx-data-pipelinecoralogix/cx-cliUse this skill when the user asks to "set up parsing", "create parsing rule", "extract fields from logs", "regex extraction", "log parsing", "enrich logs", "add4.1Kskills.sh installs
2freshtechbro avatarblender-web-pipelinefreshtechbro/claudedesignskillsBlender to web export workflows for 3D models and animations. Use this skill when exporting Blender models to glTF for web, optimizing 3D assets for Three.js or3.9Kskills.sh installs
3affaan-m avataropensource-pipelineaffaan-m/everything-claude-codeopensource pipeline3.7Kskills.sh installs
4avdlee avatarxcode-build-fixeravdlee/xcode-build-optimization-agent-skillApply approved Xcode build optimization changes following best practices, then re-benchmark to verify improvement. Use when a developer has an approved optimiza3.7Kskills.sh installs
5avdlee avatarxcode-build-orchestratoravdlee/xcode-build-optimization-agent-skillOrchestrate Xcode build optimization by benchmarking first, running the specialist analysis skills, prioritizing findings, requesting explicit approval, delegat3.7Kskills.sh installs
6giuseppe-trisciuoglio avatarwiremock-standalone-dockergiuseppe-trisciuoglio/developer-kitProvides patterns and configurations for running WireMock as a standalone Docker container. Generates mock HTTP endpoints, creates stub mappings for testing, va3.5Kskills.sh installs