
Profiling Tables
This is the kind of profiling workflow you'd normally build yourself after the third time someone asks "what's actually in this table?" It runs through the standard checklist: column metadata, row counts, type-specific statistics (min/max/avg for numbers, length distributions for strings, date ranges for timestamps), cardinality analysis to spot IDs versus categories, and a data quality assessment covering completeness, uniqueness, and freshness. The output is a structured summary with a schema table, quality scores out of 10, and a list of potential issues. It's thorough without being clever, which is exactly what you want when onboarding someone to an unfamiliar dataset or debugging why a pipeline is producing garbage.
- skills.sh installs
- 1.1K
- GitHub stars
- 459
- last updated
- Aug 21, 2026
Install
$ npx -y skills add astronomer/agents --skill profiling-tables --agent claude-codeInstalls into .claude/skills of the current project.
Files
Data Profile
Generate a comprehensive profile of a table that a new team member could use to understand the data.
Step 1: Basic Metadata
Query column metadata:
SELECT COLUMN_NAME, DATA_TYPE, COMMENT
FROM <database>.INFORMATION_SCHEMA.COLUMNS
WHERE TABLE_SCHEMA = '<schema>' AND TABLE_NAME = '<table>'
ORDER BY ORDINAL_POSITION
If the table name isn't fully qualified, search INFORMATION_SCHEMA.TABLES to locate it first.
Step 2: Size and Shape
Run via run_sql:
SELECT
COUNT(*) as total_rows,
COUNT(*) / 1000000.0 as millions_of_rows
FROM <table>
Step 3: Column-Level Statistics
For each column, gather appropriate statistics based on data type:
Numeric Columns
SELECT
MIN(column_name) as min_val,
MAX(column_name) as max_val,
AVG(column_name) as avg_val,
STDDEV(column_name) as std_dev,
PERCENTILE_CONT(0.5) WITHIN GROUP (ORDER BY column_name) as median,
SUM(CASE WHEN column_name IS NULL THEN 1 ELSE 0 END) as null_count,
COUNT(DISTINCT column_name) as distinct_count
FROM <table>
Sponsors
Details
- Repository
- github.com/astronomer/agents
- Categories
- Code Review & Quality, Data Science & ML, Debugging
- First seen
- Apr 16, 2026
More from astronomer/agents
All 24- Tracing Downstream Lineage1.1K
- Checking Freshness1K
- Annotating Task Lineage1K
- Cosmos Dbt Core990
- Airflow Hitl980
- Creating Openlineage Extractors960
- Cosmos Dbt Fusion925
- Warehouse Init841
- Deploying Airflow817
- Troubleshooting Astro Deployments655
- Airflow Plugins622
- Managing Astro Deployments595
- Blueprint584
- Init176
- Managing Astro Local Env1.6K
- Airflow1.5K
- Analyzing Data1.4K
- Authoring Dags1.3K
- Debugging Dags1.2K
- Testing Dags1.2K
- Migrating Airflow 2 To 31.1K
- Setting Up Astro Project1.1K
- Tracing Upstream Lineage1.1K