
Iac Terraform Data Engineering
This walks you through the Terraform basics for provisioning AWS data infrastructure: S3 buckets, EC2 instances, and IAM roles. It's aimed at data engineers who want reproducible infrastructure instead of clicking around the AWS console. The examples cover practical patterns like multi-bucket data lakes with versioning and lifecycle rules, plus security groups for compute instances. The IAM setup assumes you're learning or in dev mode with broad permissions, which it correctly flags as inappropriate for production. Good if you're new to IaC and want working templates to modify rather than starting from scratch, though you'll need to tighten the security policies before using any of this for real work.
- skills.sh installs
- 1.3K
- GitHub stars
- 2
- last updated
- Jul 14, 2026
Install
$ npx -y skills add aradotso/data-skills --skill iac-terraform-data-engineering --agent claude-codeInstalls into .claude/skills of the current project.
Files
IaC for Data Engineering with Terraform
Skill by ara.so — Data Skills collection.
This project provides Infrastructure-as-Code (IaC) templates and patterns for data engineers using Terraform to provision and manage AWS resources. It focuses on creating reproducible, version-controlled infrastructure for data platforms including S3 storage, EC2 compute instances, and IAM permissions.
What This Project Does
- Provides Terraform configurations for common data engineering infrastructure on AWS
- Demonstrates IaC best practices for S3 buckets, EC2 instances, and IAM roles
- Shows state management and lifecycle operations for data infrastructure
- Teaches reproducible infrastructure provisioning for data pipelines
Prerequisites
Before using this project, ensure you have:
- AWS Account with root or admin access
- Terraform CLI installed (installation guide)
- AWS CLI installed and configured (setup guide)
- AWS Credentials configured via
aws configure
AWS IAM Setup
Sponsors
Details
- Repository
- github.com/aradotso/data-skills
- Categories
- DevOps & CI/CD, Cloud & Infrastructure
- First seen
- Jul 14, 2026
More from aradotso/data-skills
All 60- Retail Etl Medallion Pipeline1.3K
- Retail Etl Pipeline Medallion1.3K
- Terraform Data Engineering Iac1.3K
- Terraform Data Engineering Infrastructure1.3K
- Terraform Iac Data Engineering1.3K
- Harvard Art Museums Data Engineering Pipeline1.2K
- Harvard Artifacts Etl Pipeline1.2K
- Snowflake Dbt Airbnb Analytics1.2K
- Data Engineering Patterns Fabric Databricks1.1K
- Game Analytics Platform Computer Vision1.1K
- Infrastructure Cicd Data Engineering1.1K
- Harvard Artifacts Collection Analytics App907
- Harvard Artifacts Etl Streamlit833
- Harvard Art Museum Data Engineering831
- Data Analytics Skills Claude735
- Car Sales Data Engineering Analytics713
- Google Cloud Data Engineering Hub662
- Harvard Art Museums Data Engineering Analytics628
- Harvard Artifacts Data Engineering Streamlit623
- Coinmarketcap Diamonds Premium Analytics608
- Harvard Art Museums Data Engineering536
- Apache Airflow Orchestration1.9K
- Datatalks Data Engineering Zoomcamp1.9K
- Llm Public Opinion Analytics Assistant1.9K