Claude MarketplacesSubmit
aradotso avatar

Harvard Artifacts Etl Streamlit

aradotso/data-skills

This is a complete ETL reference implementation that pulls artifact data from Harvard's Art Museums API and pipes it into a relational database with a Streamlit frontend for exploration. You get schema definitions for storing metadata, media URLs, and color analysis across three normalized tables, plus code for paginated extraction, transformation logic that flattens nested JSON, and batch loading with proper foreign keys. The analytics layer includes pre-built SQL queries for slicing collections by culture, century, department, and dominant colors, all visualized through Plotly charts. It's built on MySQL but the patterns translate to any relational database. Good starting point if you're learning data pipeline architecture or need to stand up a quick proof-of-concept dashboard around any public API with similar structure.

skills.sh installs
833
GitHub stars
2
last updated
Jul 14, 2026
View on GitHub

Install

$ npx -y skills add aradotso/data-skills --skill harvard-artifacts-etl-streamlit --agent claude-code

Installs into .claude/skills of the current project.

Files

Harvard Artifacts ETL & Analytics Skill

Skill by ara.so — Data Skills collection.

This skill enables AI agents to build and work with end-to-end data engineering pipelines using the Harvard Art Museums API. It demonstrates ETL workflows, SQL database design, analytics queries, and interactive Streamlit dashboards with Plotly visualizations.

What This Project Does

The Harvard Artifacts Collection Data Engineering & Analytics App provides:

  • API Integration: Fetch artifact data from Harvard Art Museums API with pagination and rate limiting
  • ETL Pipeline: Extract, transform, and load museum artifact data into relational SQL databases
  • SQL Database: Store artifacts metadata, media details, and color information with proper relationships
  • Analytics Queries: 20+ predefined SQL queries for insights on culture, century, media, colors, and departments
  • Interactive Dashboard: Streamlit-based UI with Plotly visualizations for real-time analytics

Installation

SKILL.md on GitHub

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Details

Repository
github.com/aradotso/data-skills
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60

Recommended

1juliusbrussee avatarcavemanjuliusbrussee/cavemanUltra-compressed communication mode. Cuts output tokens 65% (measured) by speaking like caveman while keeping full technical accuracy. Supports intensity levels618.3Kskills.sh installs
2mattpocock avatargrill-memattpocock/skillsA relentless interview to sharpen a plan or design.1.5Mskills.sh installs
3shadcn avatarimproveshadcn/improveSurvey any codebase as a senior advisor and produce prioritized, self-contained implementation plans for OTHER models/agents to execute. Strictly read-only on s40Kskills.sh installs
4obra avatarsystematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixes326.7Kskills.sh installs
5forrestchang avatarkarpathy-guidelinesforrestchang/andrej-karpathy-skillsBehavioral guidelines to reduce common LLM coding mistakes through explicit assumptions, simplicity, and verifiable success criteria.17.9Kskills.sh installs
6vercel-labs avatarfind-skillsvercel-labs/skillsHelps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express int4.3Mskills.sh installs