Terraform Iac Data Engineering

This walks you through provisioning AWS data infrastructure with Terraform, covering S3 buckets, EC2 instances, and IAM roles with actual configuration examples you can adapt. You get lifecycle policies for tiering data to Glacier, versioning setup, and instance profiles so your EC2 boxes can talk to S3. The repo includes environment-specific configs for dev and prod, which is helpful if you're moving beyond single-environment setups. It's oriented around the josephmachado repository, so you're learning Terraform through data engineering patterns rather than generic infrastructure examples. Good starting point if you're tired of ClickOps and want repeatable deployments for data pipelines.

skills.sh installs: 1.3K
GitHub stars: 2
last updated: Jul 14, 2026

View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill terraform-iac-data-engineering --agent claude-code

Installs into .claude/skills of the current project.

Files

Terraform IaC for Data Engineering

Skill by ara.so — Data Skills collection.

This project provides Infrastructure-as-Code (IaC) patterns using Terraform specifically for data engineering workloads on AWS. It demonstrates how to provision and manage AWS resources (S3, EC2, IAM) needed for data pipelines and processing.

What This Project Does

Provisions AWS S3 buckets for data storage
Creates EC2 instances for data processing workloads
Manages IAM users, roles, and policies
Demonstrates Terraform state management
Provides reusable IaC patterns for data engineering infrastructure

Installation

Prerequisites

Terraform CLI

# macOS
brew install terraform

# Linux
wget https://releases.hashicorp.com/terraform/1.5.0/terraform_1.5.0_linux_amd64.zip
unzip terraform_1.5.0_linux_amd64.zip
sudo mv terraform /usr/local/bin/

AWS CLI

# macOS
brew install awscli

# Linux
curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install

SKILL.md on GitHub