aradotso avatar

Data Engineering Study Material

This is a reference repository packed with Python examples covering the data engineering stack from ETL pipelines to Airflow DAGs. You'll find practical code for building pipelines with pandas and SQLAlchemy, data quality checks using Great Expectations, and orchestration patterns for AWS, GCP, and Azure. It's organized by topic (fundamentals, streaming, batch processing, cloud platforms) and includes interview prep materials. The examples are realistic enough to adapt for actual projects, like the ETL pipeline class with proper logging and error handling or the Airflow DAG with S3 to Redshift transfers. Best used as a quick reference when implementing pipelines or brushing up before interviews rather than as a tutorial to read front to back.

skills.sh installs
1.5K
GitHub stars
2
last updated
Jul 14, 2026

Install

$ npx -y skills add aradotso/data-skills --skill data-engineering-study-material --agent claude-code

Installs into .claude/skills of the current project.

Files

Data Engineering Study Material

Skill by ara.so — Data Skills collection.

Overview

This project is a comprehensive study guide and reference repository for data engineering concepts, tools, and practices. It serves as a centralized resource for learning core data engineering principles, understanding modern data stack components, and preparing for data engineering roles.

The repository covers:

  • Data engineering fundamentals and architecture patterns
  • ETL/ELT pipeline design and implementation
  • Data warehousing and lake architectures
  • Streaming and batch processing frameworks
  • Cloud data platforms (AWS, GCP, Azure)
  • Data quality, governance, and observability
  • Infrastructure as Code and orchestration tools
  • Interview preparation and best practices

Installation

This is a study material repository, not an installable package. Clone it to access the materials:

git clone https://github.com/Ahmeduddin3403/data-engineering-study-material.git
cd data-engineering-study-material

Repository Structure

The materials are typically organized by topic area:

Sponsors

Details

Repository
github.com/aradotso/data-skills
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60

Recommended

1juliusbrussee avatarcavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
2mattpocock avatargrill-memattpocock/skillsA relentless interview to sharpen a plan or design.1.5Mskills.sh installs
3shadcn avatarimproveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
4obra avatarsystematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
5forrestchang avatarkarpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
6vercel-labs avatarfind-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs