Infrastructure Cicd Data Engineering

This sets up the CI/CD plumbing for deploying data infrastructure with Terraform and GitHub Actions, using AWS OIDC so you're not passing around long-lived credentials. You get a bootstrap setup that creates your S3 state backend and the IAM roles GitHub needs, then workflows that run terraform plan on PRs and terraform apply on merges with a manual approval gate for production. It's the standard pattern most teams eventually land on after a few months of clicking around the AWS console or running terraform from their laptops. The bootstrap step is the annoying part everyone has to do once, and this just gives you the working config so you can copy it and move on to actually building your data platform.

skills.sh installs: 1.1K
GitHub stars: 2
last updated: Jul 14, 2026

View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill infrastructure-cicd-data-engineering --agent claude-code

Installs into .claude/skills of the current project.

Files

Infrastructure CI/CD for Data Engineering

Skill by ara.so — Data Skills collection

This project demonstrates practical CI/CD patterns for deploying data infrastructure changes using GitHub Actions, Terraform, and AWS. It uses OpenID Connect (OIDC) for secure, keyless authentication between GitHub Actions and AWS, eliminating the need for long-lived AWS credentials.

What This Project Does

Bootstraps infrastructure: Creates S3 backend for Terraform state and OIDC provider for GitHub Actions
Automates deployments: Uses GitHub Actions workflows to plan and apply Terraform changes
Enforces reviews: Requires manual approval before production deployments
Validates code: Runs Terraform formatting and validation checks on PRs

Project Structure

.
├── terraform/
│   ├── bootstrap/          # Initial setup (S3 backend, OIDC)
│   │   └── main.tf
│   └── main/              # Main infrastructure definitions
│       └── main.tf
├── .github/
│   └── workflows/
│       ├── ci.yml         # Format and validation checks
│       └── deploy.yml     # Deployment workflow
└── tear-down.sh           # Cleanup script