
Data Engineering Study Material
This is a reference repository packed with Python examples covering the data engineering stack from ETL pipelines to Airflow DAGs. You'll find practical code for building pipelines with pandas and SQLAlchemy, data quality checks using Great Expectations, and orchestration patterns for AWS, GCP, and Azure. It's organized by topic (fundamentals, streaming, batch processing, cloud platforms) and includes interview prep materials. The examples are realistic enough to adapt for actual projects, like the ETL pipeline class with proper logging and error handling or the Airflow DAG with S3 to Redshift transfers. Best used as a quick reference when implementing pipelines or brushing up before interviews rather than as a tutorial to read front to back.
- skills.sh installs
- 1.5K
- GitHub stars
- 2
- last updated
- Jul 14, 2026
Install
$ npx -y skills add aradotso/data-skills --skill data-engineering-study-material --agent claude-codeInstalls into .claude/skills of the current project.
Files
Data Engineering Study Material
Skill by ara.so — Data Skills collection.
Overview
This project is a comprehensive study guide and reference repository for data engineering concepts, tools, and practices. It serves as a centralized resource for learning core data engineering principles, understanding modern data stack components, and preparing for data engineering roles.
The repository covers:
- Data engineering fundamentals and architecture patterns
- ETL/ELT pipeline design and implementation
- Data warehousing and lake architectures
- Streaming and batch processing frameworks
- Cloud data platforms (AWS, GCP, Azure)
- Data quality, governance, and observability
- Infrastructure as Code and orchestration tools
- Interview preparation and best practices
Installation
This is a study material repository, not an installable package. Clone it to access the materials:
git clone https://github.com/Ahmeduddin3403/data-engineering-study-material.git
cd data-engineering-study-material
Repository Structure
The materials are typically organized by topic area:
Sponsors
Details
- Repository
- github.com/aradotso/data-skills
- First seen
- Jul 14, 2026
More from aradotso/data-skills
All 60- Employee Performance Analytics Hr1.5K
- Enterprise Data Engineering Pipeline Ssis Pyspark1.5K
- Harvard Art Museum Data Pipeline1.5K
- Harvard Art Museum Etl Analytics1.5K
- Harvard Art Museums Data Pipeline1.5K
- Harvard Art Museums Etl Analytics1.5K
- Harvard Artifacts Data Engineering Analytics1.5K
- Harvard Artifacts Data Engineering App1.5K
- Harvard Artifacts Data Engineering Pipeline1.5K
- Harvard Artifacts Etl Analytics1.5K
- Llm Intelligent Public Opinion Analytics1.5K
- Options Analytics Agent Langgraph1.5K
- Realtime Cinema Data Engineering Pipeline1.5K
- Harvard Artifacts Collection Analytics Pipeline1.4K
- Harvard Artifacts Collection Data Engineering1.4K
- Harvard Artifacts Collection Data Engineering Analytics1.4K
- Harvard Artifacts Collection Etl Analytics1.4K
- Harvard Artifacts Etl Streamlit Analytics1.4K
- Harvard Art Museums Data Engineering App1.3K
- Harvard Art Museums Etl Pipeline1.3K
- Harvard Artifacts Data Pipeline1.3K
- Iac Data Engineering Terraform1.3K
- Iac Terraform Data Engineering1.3K
- Retail Etl Medallion Pipeline1.3K