Senior Data Engineer

This is a comprehensive data engineering skill that goes deep on production pipelines, ETL/ELT patterns, and data infrastructure. You get expertise across the modern data stack (Spark, Airflow, dbt, Kafka) plus actual implementation guidance for distributed processing, data quality validation, and pipeline orchestration. The skill covers both batch and real-time patterns, includes data modeling strategies, and handles DataOps concerns like monitoring and deployment. What stands out is the focus on scalability and production readiness rather than just getting pipelines running. Use this when you're building serious data infrastructure that needs to handle scale, not just proof-of-concept workflows.

skills.sh installs: 1.8K
GitHub stars: 33.2K
last updated: Aug 21, 2026

View on GitHub

Install

$ npx -y skills add davila7/claude-code-templates --skill senior-data-engineer --agent claude-code

Installs into .claude/skills of the current project.

Files

Senior Data Engineer

World-class senior data engineer skill for production-grade AI/ML/Data systems.

Quick Start

Main Capabilities

# Core Tool 1
python scripts/pipeline_orchestrator.py --input data/ --output results/

# Core Tool 2  
python scripts/data_quality_validator.py --target project/ --analyze

# Core Tool 3
python scripts/etl_performance_optimizer.py --config config.yaml --deploy