Tracks AI chatbot performance without storing conversation content, which matters if you're dealing with sensitive data. You get the 13 metrics that actually matter: session counts, message volumes, token usage for cost tracking, response times, and error rates. The implementation is smart about HIPAA compliance by deriving categories from metadata flags rather than analyzing message text. The aggregation queries are ready to use for building dashboards, and the alert configuration catches concerning patterns like crisis spikes or abandonment rates. This is basically the analytics layer you'd build yourself after your first month of running a chatbot in production, except someone already thought through the privacy implications.

skills.sh installs
120
GitHub stars
113
last updated
Jun 3, 2026

Install

$ npx -y skills add erichowens/some_claude_skills --skill chatbot-analytics --agent claude-code

Installs into .claude/skills of the current project.

Files

AI Chatbot Analytics

This skill helps you implement analytics for the AI coaching chat feature while maintaining HIPAA compliance.

Core Metrics to Track

Based on industry best practices, track these 13 key metrics:

MetricDescriptionHIPAA Safe?
Total SessionsNumber of chat sessionsYes
Avg Messages/SessionMessages per conversationYes
Avg Session DurationTime spent in chatYes
Engagement Rate% users who use chatYes
Completion RateSessions ended naturallyYes
Abandonment RateSessions ended earlyYes
Response TimeAI response latencyYes
Token UsageTotal/avg tokens consumedYes
Error RateFailed responsesYes
Fallback Rate"I don't understand" responsesYes
Topic CategoriesWhat users discussMetadata only
Sentiment TrendEmotional directionDerived only
Crisis TriggersEmergency detectionMetadata only

HIPAA-Compliant Analytics

What to Track

Sponsors

Details

Repository
github.com/erichowens/some_claude_skills
Categories
AI & Agent Building, Data Science & ML, Marketing & SEO
First seen
Jun 3, 2026

More from erichowens/some_claude_skills

All 73
1skillcreatorai avatarvercel-deployskillcreatorai/ai-agent-skillsvercel deploy120skills.sh installs
2charleswiltgen avataraxiom-xcode-mcp-refcharleswiltgen/axiomReference — all 20 Xcode MCP tools with parameters, return schemas, and examples119skills.sh installs
3cinience avataralicloud-ai-multimodal-qwen-omni-testcinience/alicloud-skillsMinimal multimodal omni smoke test for Model Studio Qwen Omni.119skills.sh installs
4cinience avataralicloud-ai-search-rerank-testcinience/alicloud-skillsMinimal rerank smoke test for Model Studio rerank models.119skills.sh installs
5shipshitdev avatarai-loading-uxshipshitdev/libraryai loading ux118skills.sh installs
6skillcreatorai avatarqa-regressionskillcreatorai/ai-agent-skillsqa regression118skills.sh installs