Apache Airflow Orchestration
This is your comprehensive reference for building production Airflow pipelines, covering everything from basic DAG definitions to advanced patterns like dynamic task generation, conditional branching with BranchPythonOperator, and TaskGroups for organizing complex workflows. You'll find practical examples of task dependencies (the >> and << operators, chain and cross_downstream patterns), XCom for inter-task communication, and guidance on choosing executors from LocalExecutor for dev to KubernetesExecutor for production. The skill shines when you need to orchestrate multi-step ETL workflows with dependencies, but be aware that Airflow's learning curve is real. The DAG-as-code approach is powerful once you understand concepts like catchup behavior and scheduling intervals, but debugging can be frustrating until you're familiar with the execution model.
- skills.sh installs
- 438
- GitHub stars
- 63
- last updated
- Aug 21, 2026
Install
$ npx -y skills add manutej/luxor-claude-marketplace --skill apache-airflow-orchestration --agent claude-codeInstalls into .claude/skills of the current project.
Files
Apache Airflow Orchestration
A comprehensive skill for mastering Apache Airflow workflow orchestration. This skill covers DAG development, operators, sensors, task dependencies, dynamic workflows, XCom communication, scheduling patterns, and production deployment strategies.
When to Use This Skill
Use this skill when:
- Building and managing complex data pipelines with task dependencies
- Orchestrating ETL/ELT workflows across multiple systems
- Scheduling and monitoring batch processing jobs
- Coordinating multi-step data transformations
- Managing workflows with conditional execution and branching
- Implementing event-driven or asset-based workflows
- Deploying production-grade workflow automation
- Creating dynamic workflows that generate tasks programmatically
- Coordinating distributed task execution across clusters
- Building data engineering platforms with workflow orchestration
Core Concepts
What is Apache Airflow?
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageDetails
- Repository
- github.com/manutej/luxor-claude-marketplace
- Categories
- Documentation, Automation & Workflows
- First seen
- Jun 3, 2026
More from manutej/luxor-claude-marketplace
All 66- Terraform Infrastructure438
- Claude Sdk Integration Patterns437
- Svelte Development436
- Unix Goto Development428
- FastAPI Customer Support Tech Enablement
- PostgreSQL Database Administration
- Sqlalchemy Orm Expert
- Docker Compose Orchestration3K
- Postgresql Database Engineering1.8K
- Playwright Visual Testing1.4K
- Golang Backend Development1.4K
- Jest React Testing1.2K
- Pytest Patterns858
- Ui Design Patterns854
- Ux Principles838
- Frontend Architecture728
- Axum Web Framework659
- Alembic645
- Oauth2 Authentication603
- Aws Cloud Architecture595
- Fastapi Microservices Development590
- Wireframing568
- Expressjs Development562
- Mobile Design553
Recommended
More Documentation
write-e2e-teststldraw/tldrawWriting Playwright E2E tests for tldraw. Use when creating browser tests, testing UI interactions, or adding E2E coverage in apps/examples/e2e or apps/dotcom/cl436skills.sh installs
drizzle-orm-d1secondsky/claude-skills| Type-safe ORM for Cloudflare D1 databases using Drizzle. Use when: building D1 database schemas, writing type-safe SQL queries, managing migrations with Drizz435skills.sh installs
competency-builderjwynia/agent-skillsGuide competency framework development and operation. Use when building training that produces capability, when existing training doesn't produce competence, wh434skills.sh installs
n8n-conventionsn8n-io/n8nQuick reference for n8n patterns. Full docs /AGENTS.md433skills.sh installs
headline-formulasguia-matthieu/clawfu-skills25+ proven headline formulas that stop the scroll, capture attention, and drive clicks. Templates and examples for every situation. Use when: Writing headlines 431skills.sh installs
c4-architecturedavila7/claude-code-templatesGenerate architecture documentation using C4 model Mermaid diagrams. Use when asked to create architecture diagrams, document system architecture, visualize sof430skills.sh installs