Claude MarketplacesSubmit
alirezarezvani avatar

Senior Data Engineer

alirezarezvani/claude-skills

This is a comprehensive prompt for tackling senior-level data engineering work, from designing data pipelines to optimizing distributed systems. You'd reach for this when you need to architect a lakehouse, debug Spark performance issues, or make decisions about data modeling and infrastructure at scale. It covers the full stack: ingestion, transformation, storage, orchestration, and monitoring. The scope is wide, which makes it flexible for different data platform challenges, though you'll want to provide specific context about your stack and business requirements to get the most relevant guidance. Solid choice if you're building production data systems and need architectural thinking, not just code snippets.

skills.sh installs
1.2K
GitHub stars
29.5K
last updated
Aug 21, 2026
View on GitHub

Install

$ npx -y skills add alirezarezvani/claude-skills --skill senior-data-engineer --agent claude-code

Installs into .claude/skills of the current project.

Files

Senior Data Engineer

Production-grade data engineering skill for building scalable, reliable data systems.

Table of Contents

  1. Trigger Phrases
  2. Quick Start
  3. Workflows
  4. Architecture Decision Framework
  5. Tech Stack
  6. Reference Documentation
  7. Troubleshooting

Trigger Phrases

Activate this skill when you see:

Pipeline Design:

  • "Design a data pipeline for..."
  • "Build an ETL/ELT process..."
  • "How should I ingest data from..."
  • "Set up data extraction from..."

Architecture:

  • "Should I use batch or streaming?"
  • "Lambda vs Kappa architecture"
  • "How to handle late-arriving data"
  • "Design a data lakehouse"

Data Modeling:

  • "Create a dimensional model..."
  • "Star schema vs snowflake"
  • "Implement slowly changing dimensions"
  • "Design a data vault"

Data Quality:

  • "Add data validation to..."
  • "Set up data quality checks"
  • "Monitor data freshness"
  • "Implement data contracts"
SKILL.md on GitHub

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Repository
github.com/alirezarezvani/claude-skills
Categories
DevOps & CI/CD, Code Review & Quality, Debugging, Automation & Workflows, Python, Sales & Marketing, Cloud & Infrastructure, Databases
First seen
Jun 3, 2026

More from alirezarezvani/claude-skills

All 267

Recommended

More DevOps & CI/CD
1databricks avatardatabricks-appsdatabricks/databricks-agent-skillsBuild apps on Databricks Apps platform. Use when asked to create data apps, analytics tools, or custom interactive visualizations. A plain "create a dashboard" 1.1Kskills.sh installs
2orchestra-research avatarmlfloworchestra-research/ai-research-skillsTrack ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycl1.1Kskills.sh installs
3cognitedata avatarflows-design-reviewcognitedata/builder-skillsSemi-automated design quality review for Flows apps. Runs concrete repo probes (grep, lint, build) to propose a draft 1–5 score for each of the official 10 qual1.1Kskills.sh installs
4kostja94 avatarresearch-sourceskostja94/marketing-skillsWhen the user wants to find information sources for content ideation, competitor monitoring, or industry tracking. Also use when the user mentions "research sou1.1Kskills.sh installs
5nvidia avatarjetson-promote-imagenvidia/skillsUse to promote overlay files and built artifacts into the staged BSP image. Do NOT use to flash or build. Triggers: promote bsp image.1.1Kskills.sh installs
6chongdashu avatarphaser-gamedevchongdashu/phaserjs-tinyswordsBuild 2D games with Phaser 3 framework. Covers scene lifecycle, sprites, physics (Arcade/Matter), tilemaps, animations, input handling, and game architecture. T1.1Kskills.sh installs