astronomer avatar

Profiling Tables

This is the kind of profiling workflow you'd normally build yourself after the third time someone asks "what's actually in this table?" It runs through the standard checklist: column metadata, row counts, type-specific statistics (min/max/avg for numbers, length distributions for strings, date ranges for timestamps), cardinality analysis to spot IDs versus categories, and a data quality assessment covering completeness, uniqueness, and freshness. The output is a structured summary with a schema table, quality scores out of 10, and a list of potential issues. It's thorough without being clever, which is exactly what you want when onboarding someone to an unfamiliar dataset or debugging why a pipeline is producing garbage.

skills.sh installs
1.1K
GitHub stars
459
last updated
Aug 21, 2026

Install

$ npx -y skills add astronomer/agents --skill profiling-tables --agent claude-code

Installs into .claude/skills of the current project.

Files

Data Profile

Generate a comprehensive profile of a table that a new team member could use to understand the data.

Step 1: Basic Metadata

Query column metadata:

SELECT COLUMN_NAME, DATA_TYPE, COMMENT
FROM <database>.INFORMATION_SCHEMA.COLUMNS
WHERE TABLE_SCHEMA = '<schema>' AND TABLE_NAME = '<table>'
ORDER BY ORDINAL_POSITION

If the table name isn't fully qualified, search INFORMATION_SCHEMA.TABLES to locate it first.

Step 2: Size and Shape

Run via run_sql:

SELECT
    COUNT(*) as total_rows,
    COUNT(*) / 1000000.0 as millions_of_rows
FROM <table>

Step 3: Column-Level Statistics

For each column, gather appropriate statistics based on data type:

Numeric Columns

SELECT
    MIN(column_name) as min_val,
    MAX(column_name) as max_val,
    AVG(column_name) as avg_val,
    STDDEV(column_name) as std_dev,
    PERCENTILE_CONT(0.5) WITHIN GROUP (ORDER BY column_name) as median,
    SUM(CASE WHEN column_name IS NULL THEN 1 ELSE 0 END) as null_count,
    COUNT(DISTINCT column_name) as distinct_count
FROM <table>

Sponsors

Details

Repository
github.com/astronomer/agents
Categories
Code Review & Quality, Data Science & ML, Debugging
First seen
Apr 16, 2026

More from astronomer/agents

All 24
1digitalsamba avatarfrontend-designdigitalsamba/claude-code-video-toolkitCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applicat1.1Kskills.sh installs
2jezweb avatarstrategy-documentjezweb/claude-skillsWrite structured strategic documents for small and medium businesses: SWOT analyses, lean business plans, OKRs, competitive analyses. Each mode has a defined st1.1Kskills.sh installs
3digitalsamba avataracestepdigitalsamba/claude-code-video-toolkitAI music generation with ACE-Step 1.5 — background music, vocal tracks, covers, stem extraction, audio repainting, and continuation for video production. Use wh1Kskills.sh installs
4orchestra-research avatarevaluating-llms-harnessorchestra-research/ai-research-skillsEvaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting 1Kskills.sh installs
5jezweb avatarus-business-englishjezweb/claude-skillsAmerican business English writing style for professional communications — direct, action-oriented, EN-US spelling (color, organize, center). Use whenever the us1Kskills.sh installs
6mindrally avataroptimized-nextjs-typescriptmindrally/skillsOptimized Next.js TypeScript best practices with modern UI/UX, focusing on performance, security, and clean architecture1Kskills.sh installs