aradotso avatar

Data Engineering Patterns Fabric Databricks

This gives you 600+ data engineering patterns split across Microsoft Fabric and Azure Databricks, organized into 12 PDF books you can reference while building pipelines. It covers the practical stuff like Delta Lake merge operations, Auto Loader configurations, Unity Catalog governance, and cluster optimization for cost control. The patterns include actual code snippets for common scenarios like incremental loads, change data capture, and time travel queries. If you're working in the Azure data stack and tired of piecing together best practices from scattered docs, this consolidates field-tested approaches in one repo. The PySpark handbook works across both platforms, which is helpful since Fabric and Databricks share that layer but diverge everywhere else.

skills.sh installs
1.1K
GitHub stars
2
last updated
Jul 14, 2026

Install

$ npx -y skills add aradotso/data-skills --skill data-engineering-patterns-fabric-databricks --agent claude-code

Installs into .claude/skills of the current project.

Files

Data Engineering Patterns - Fabric & Databricks

Skill by ara.so — Data Skills collection.

This skill provides access to 600+ field-tested data engineering patterns for Microsoft Fabric, Azure Databricks, and PySpark. These patterns cover everything from pipeline design and Delta Lake optimization to Unity Catalog governance and cost architecture.

What This Project Provides

A comprehensive collection of patterns organized into 12 books covering:

Microsoft Fabric (250 patterns):

  • Pipelines and Data Factory
  • Lakehouse and PySpark
  • Warehouse and SQL
  • Power BI in Fabric
  • Architecture Patterns

Azure Databricks (350 patterns):

  • Clusters and Compute
  • Delta Lake
  • Workflows and Orchestration
  • Structured Streaming and Auto Loader
  • Unity Catalog
  • Databricks SQL and Photon
  • Platform and Cost Architecture

PySpark:

  • 88 concepts for production Spark across both platforms

Installation

Clone the repository to access all pattern PDFs:

git clone https://github.com/ssanjaychandra123/data-engineering-patterns.git
cd data-engineering-patterns

Repository Structure

Sponsors

Details

Repository
github.com/aradotso/data-skills
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60

Recommended

1juliusbrussee avatarcavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
2mattpocock avatargrill-memattpocock/skillsA relentless interview to sharpen a plan or design.1.5Mskills.sh installs
3shadcn avatarimproveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
4obra avatarsystematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
5forrestchang avatarkarpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
6vercel-labs avatarfind-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs