Retail Etl Pipeline Medallion

This builds a three-tier medallion architecture ETL pipeline for retail data using PySpark and SQL Server. You get Bronze for raw CSV ingestion, Silver for cleansing and deduplication, and Gold for business metrics like inventory shrinkage and sales aggregations. The included SQL scripts handle the full flow from bulk inserts through stored procedures that calculate things like expected stock versus actual and supplier rebate tiers. It's overkill for small shops but solid if you're consolidating multi-branch inventory and sales data and need proper data quality layers. The shrinkage calculation logic is particularly well thought out, joining stock levels against sales to find discrepancies.

skills.sh installs: 1.3K
GitHub stars: 2
last updated: Jul 14, 2026

View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill retail-etl-pipeline-medallion --agent claude-code

Installs into .claude/skills of the current project.

Files

Retail ETL Pipeline - Medallion Architecture Skill

Skill by ara.so — Data Skills collection

Overview

The Retail ETL Pipeline project implements a complete data engineering solution for retail operations using the Medallion Architecture pattern (Bronze → Silver → Gold layers). It handles complex retail scenarios including:

Inventory shrinkage resolution
Recipe conversions for meat/poultry products
Supplier rebate tier tracking
Multi-branch sales consolidation
Stock level management across locations

The pipeline processes raw CSV data from CRM/ERP systems through three progressive quality layers, ultimately delivering a "Single Version of Truth" for business intelligence.