aradotso avatar

Harvard Artifacts Etl Streamlit Analytics

You're looking at a complete ETL pipeline tutorial that pulls artifact data from Harvard Art Museums' public API into a MySQL database, then visualizes it with Streamlit and Plotly. It handles pagination and rate limiting on the API side, structures data across three normalized tables (metadata, media URLs, and color analysis), and includes pre-built analytical queries for culture distributions and color patterns. The repo comes with schema definitions and batch insert logic. Honestly, this is more of a learning project than production infrastructure, but it's a solid reference if you need to wire up any museum API to a dashboard and want working code for the whole stack.

skills.sh installs
1.4K
GitHub stars
2
last updated
Jul 14, 2026

Install

$ npx -y skills add aradotso/data-skills --skill harvard-artifacts-etl-streamlit-analytics --agent claude-code

Installs into .claude/skills of the current project.

Files

Harvard Artifacts ETL & Analytics Skill

Skill by ara.so — Data Skills collection.

This skill enables AI coding agents to help developers build end-to-end data engineering and analytics applications using the Harvard Art Museums API. The project demonstrates ETL pipelines, SQL database design, analytical queries, and interactive Streamlit visualizations for museum artifact data.

What This Project Does

The Harvard Artifacts Collection Data Engineering & Analytics App provides:

  • API Integration: Fetch artifact data from Harvard Art Museums API with pagination and rate limiting
  • ETL Pipeline: Extract, transform, and load artifact metadata, media, and color data into relational SQL tables
  • SQL Analytics: Pre-built analytical queries for insights on culture, century, media availability, and color patterns
  • Interactive Dashboard: Streamlit-based UI with Plotly visualizations for query results

Installation

Prerequisites

Setup Steps

Sponsors

Details

Repository
github.com/aradotso/data-skills
Categories
Data Science & ML, Marketing & SEO
First seen
Jul 14, 2026

More from aradotso/data-skills

All 60
1kostja94 avatarcompetitor-researchkostja94/marketing-skillsWhen the user wants to analyze competitors for SEO, content, backlinks, or positioning. Also use when the user mentions "competitor analysis," "competitor resea1.4Kskills.sh installs
2orchestra-research avatarbrainstorming-research-ideasorchestra-research/ai-research-skillsGuides researchers through structured ideation frameworks to discover high-impact research directions. Use when exploring new problem spaces, pivoting between p1.3Kskills.sh installs
3nexscope-ai avataramazon-seller-analyticsnexscope-ai/amazon-skillsSeller storefront analysis and competitive intelligence for Amazon. Analyzes seller revenue estimation, product portfolio strategy, growth trajectory, and marke1.3Kskills.sh installs
4aradotso avatargit-city-3d-github-visualizationaradotso/trending-skillsgit city 3d github visualization1.3Kskills.sh installs
5orchestra-research avatarcreative-thinking-for-researchorchestra-research/ai-research-skillsApplies cognitive science frameworks for creative thinking to CS and AI research ideation. Use when seeking genuinely novel research directions by leveraging co1.3Kskills.sh installs
6bradautomates avatartiktok-researchbradautomates/head-of-contentResearch high-performing TikTok videos from tracked accounts using Apify's TikTok Scraper. Identifies outlier content, analyzes top 5 videos with AI, and genera1.2Kskills.sh installs