Claude MarketplacesSubmit
aradotso avatar

Harvard Artifacts Data Engineering Streamlit

aradotso/data-skills

This is a full-stack data engineering tutorial wrapped in a Claude skill. It walks through building an ETL pipeline that pulls artifact data from Harvard Art Museums API, normalizes it into MySQL tables (metadata, media, colors), then visualizes the results in a Streamlit dashboard with Plotly charts. The skill includes 20+ prebuilt analytical queries for slicing museum collections by culture, century, and department. It's honestly more of a learning project than production tooling, but that's the point. You get hands-on practice with API pagination, relational database design with foreign keys, and interactive dashboards. Good for portfolio work or if you're learning data engineering patterns with real cultural heritage data instead of yet another retail dataset.

skills.sh installs
623
GitHub stars
2
last updated
Jul 14, 2026
View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill harvard-artifacts-data-engineering-streamlit --agent claude-code

Installs into .claude/skills of the current project.

Files

Harvard Artifacts Collection Data Engineering & Analytics

Skill by ara.so — Data Skills collection.

This project provides an end-to-end data engineering and analytics application for the Harvard Art Museums API. It demonstrates real-world ETL pipelines, SQL database design, analytical queries, and interactive Streamlit visualizations for museum artifact data.

What This Project Does

  • Data Collection: Fetches artifact data from Harvard Art Museums API with pagination and rate limiting
  • ETL Pipeline: Extracts, transforms, and loads artifact metadata, media, and color information into relational SQL databases
  • SQL Analytics: Runs 20+ predefined analytical queries for insights on artifacts by culture, century, department, and media
  • Visualization: Creates interactive Plotly dashboards in Streamlit for exploring query results
  • Database Management: Manages MySQL/TiDB Cloud schemas with proper foreign key relationships

Installation

Prerequisites

# Required Python packages
pip install streamlit pandas requests mysql-connector-python plotly python-dotenv

Or use requirements file:

SKILL.md on GitHub

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Repository
github.com/aradotso/data-skills
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60

Recommended

1juliusbrussee avatarcavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
2mattpocock avatargrill-memattpocock/skillsA relentless interview to sharpen a plan or design.1.5Mskills.sh installs
3shadcn avatarimproveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
4obra avatarsystematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
5forrestchang avatarkarpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
6vercel-labs avatarfind-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs