aradotso avatar

Apache Airflow Orchestration

This one gives Claude the context to help you build and debug Apache Airflow DAGs without constantly checking docs. It covers the TaskFlow API decorator syntax (the modern way to write pipelines), common operators like BashOperator and BranchPythonOperator, and sensors for waiting on files or conditions. The examples show real patterns like XCom for passing data between tasks, dynamic templating with execution dates, and branching logic. Useful if you're orchestrating data pipelines and need quick answers on retry configs, dependency chains, or why your tasks aren't triggering. The Docker setup instructions are solid for getting a local instance running fast.

skills.sh installs
1.9K
GitHub stars
2
last updated
Jul 14, 2026

Install

$ npx -y skills add aradotso/data-skills --skill apache-airflow-orchestration --agent claude-code

Installs into .claude/skills of the current project.

Files

Apache Airflow Orchestration

Skill by ara.so — Data Skills collection.

Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. It allows you to define workflows as Directed Acyclic Graphs (DAGs) in Python code, making them maintainable, versionable, testable, and collaborative.

Installation

Using pip

# Install Airflow with constraints for your Python version
AIRFLOW_VERSION=3.2.0
PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)"
CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt"

pip install "apache-airflow==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}"

Using Docker (Recommended for Development)

# Download docker-compose.yaml
curl -LfO 'https://airflow.apache.org/docs/apache-airflow/stable/docker-compose.yaml'

# Create required directories
mkdir -p ./dags ./logs ./plugins ./config

# Set the Airflow user
echo -e "AIRFLOW_UID=$(id -u)" > .env

# Initialize the database
docker compose up airflow-init

# Start Airflow
docker compose up

Sponsors

Details

Repository
github.com/aradotso/data-skills
Category
Automation & Workflows
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60
1sickn33 avatarapi-documentation-generatorsickn33/antigravity-awesome-skillsapi documentation generator1.9Kskills.sh installs
2nvidia avatarnemotron-policy-generatornvidia/skillsGenerates BYO custom safety policies for NVIDIA Nemotron content-safety guardrails — Nemotron-Content-Safety-Reasoning-4B (text) and multimodal Nemotron-3-Conte1.9Kskills.sh installs
3grasseed avatargoogle-search-browser-usegrasseed/google-search-browser-useUse browser-use to perform Google searches, open results, and extract key information from live pages. Use when the user asks to "search Google", "look this up 1.9Kskills.sh installs
4aj-geddes avataransible-automationaj-geddes/useful-ai-promptsInfrastructure automation and configuration management using Ansible playbooks, roles, and inventory. Use for deploying applications, patching, and managing ser1.9Kskills.sh installs
5freestylefly avatarxiaohongshu-cover-generatorfreestylefly/xiaohongshu-skillsGenerate Xiaohongshu (小红书) style cover images based on user topics. Use when the user wants to create a social media cover image in Xiaohongshu style, or mentio1.9Kskills.sh installs
6nvidia avatarnemo-mbridge-perf-expert-parallel-overlapnvidia/skillsValidate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlap_moe_expert_parallel_comm, delay_wgrad_compute, and flex dispatc1.8Kskills.sh installs