aradotso avatar

Iac Terraform Data Engineering

This walks you through the Terraform basics for provisioning AWS data infrastructure: S3 buckets, EC2 instances, and IAM roles. It's aimed at data engineers who want reproducible infrastructure instead of clicking around the AWS console. The examples cover practical patterns like multi-bucket data lakes with versioning and lifecycle rules, plus security groups for compute instances. The IAM setup assumes you're learning or in dev mode with broad permissions, which it correctly flags as inappropriate for production. Good if you're new to IaC and want working templates to modify rather than starting from scratch, though you'll need to tighten the security policies before using any of this for real work.

skills.sh installs
1.3K
GitHub stars
2
last updated
Jul 14, 2026

Install

$ npx -y skills add aradotso/data-skills --skill iac-terraform-data-engineering --agent claude-code

Installs into .claude/skills of the current project.

Files

IaC for Data Engineering with Terraform

Skill by ara.so — Data Skills collection.

This project provides Infrastructure-as-Code (IaC) templates and patterns for data engineers using Terraform to provision and manage AWS resources. It focuses on creating reproducible, version-controlled infrastructure for data platforms including S3 storage, EC2 compute instances, and IAM permissions.

What This Project Does

  • Provides Terraform configurations for common data engineering infrastructure on AWS
  • Demonstrates IaC best practices for S3 buckets, EC2 instances, and IAM roles
  • Shows state management and lifecycle operations for data infrastructure
  • Teaches reproducible infrastructure provisioning for data pipelines

Prerequisites

Before using this project, ensure you have:

  1. AWS Account with root or admin access
  2. Terraform CLI installed (installation guide)
  3. AWS CLI installed and configured (setup guide)
  4. AWS Credentials configured via aws configure

AWS IAM Setup

Sponsors

Details

Repository
github.com/aradotso/data-skills
Categories
DevOps & CI/CD, Cloud & Infrastructure
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60
1aradotso avatarretail-etl-pipeline-medallionaradotso/data-skillsretail etl pipeline medallion1.3Kskills.sh installs
2aradotso avatarterraform-data-engineering-iacaradotso/data-skillsterraform data engineering iac1.3Kskills.sh installs
3aradotso avatarterraform-data-engineering-infrastructurearadotso/data-skillsterraform data engineering infrastructure1.3Kskills.sh installs
4aradotso avatarterraform-iac-data-engineeringaradotso/data-skillsterraform iac data engineering1.3Kskills.sh installs
5jaganpro avatarsf-ai-agentforce-observabilityjaganpro/sf-skillssf ai agentforce observability1.3Kskills.sh installs
6aradotso avatarharvard-art-museums-data-engineering-pipelinearadotso/data-skillsharvard art museums data engineering pipeline1.2Kskills.sh installs