Terraform Data Engineering Infrastructure

This walks you through provisioning AWS data infrastructure with Terraform, covering S3 buckets for data lakes, EC2 instances for processing, and IAM roles to wire it all together securely. The examples are practical and include the full setup from installing prerequisites to multi-environment configurations with variables. It's solid for getting a reproducible data platform off the ground or learning IaC patterns if you're coming from manual AWS console work. The IAM permissions are intentionally broad for learning, which the author flags clearly. You'll need an AWS account and basic familiarity with the command line, but the step-by-step commands make it approachable even if you haven't touched Terraform before.

skills.sh installs: 1.3K
GitHub stars: 2
last updated: Jul 14, 2026

View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill terraform-data-engineering-infrastructure --agent claude-code

Installs into .claude/skills of the current project.

Files

Terraform Data Engineering Infrastructure

Skill by ara.so — Data Skills collection.

This project provides Infrastructure-as-Code (IaC) patterns for data engineering teams using Terraform to provision and manage AWS resources. It demonstrates how to automate the creation of data infrastructure including S3 buckets for data lakes, EC2 instances for processing, and IAM policies for secure access.

What This Project Does

Provisions AWS infrastructure specifically designed for data engineering workloads
Manages S3 buckets for data storage and data lake architectures
Creates EC2 instances for data processing and ETL jobs
Configures IAM roles and policies for secure resource access
Provides declarative infrastructure definitions that can be version-controlled
Enables reproducible environment creation across dev/staging/prod