
Llm Public Opinion Analytics
This is a production-ready public opinion monitoring system that scrapes 26 ranking lists across 15 Chinese platforms including Weibo, Bilibili, and Douyin, then runs LLM analysis on top. You get topic clustering, sentiment analysis, and automated alerts through WeChat Work, Telegram, or email. The architecture is solid: Scrapy for data collection, MySQL for storage, FastAPI for the web interface, and OpenAI-compatible APIs for analysis. It even handles video content extraction and includes keyboard shortcuts for crawler control. If you're monitoring Chinese social media trends or building a brand reputation system, this gives you the full stack. Setup requires some work with browser drivers and environment variables, but the documentation walks through database schemas and API endpoints clearly enough.
- skills.sh installs
- 1.7K
- GitHub stars
- 2
- last updated
- Jul 14, 2026
Install
$ npx -y skills add aradotso/data-skills --skill llm-public-opinion-analytics --agent claude-codeInstalls into .claude/skills of the current project.
Files
LLM-Based Public Opinion Analytics Assistant
Skill by ara.so — Data Skills collection.
Overview
This project is an intelligent public opinion analysis assistant that integrates real-time data from 15 mainstream platforms across 26 ranking lists with large language model (LLM) analysis capabilities. It provides conversational hot search queries, topic-specific searches, topic clustering, and sentiment analysis. The system supports:
- Real-time web scraping from platforms like Weibo, Bilibili, Douyin, Baidu, etc.
- LLM-powered content analysis (including video content extraction)
- Multi-channel push notifications (WeChat, Enterprise WeChat, Telegram, Email)
- Keyboard shortcuts for crawler control
- Quick data lookup and platform jumping
Installation
Prerequisites
- Python Environment: Python 3.8+
- MySQL Database: MySQL 5.7+ or 8.0+
- Browser Driver: ChromeDriver or EdgeDriver
Step 1: Browser Driver Setup
Download the driver matching your browser version:
Sponsors
Details
- Repository
- github.com/aradotso/data-skills
- Categories
- AI & Agent Building, Data Science & ML, Marketing & SEO
- First seen
- Jul 14, 2026
More from aradotso/data-skills
All 60- Altimate Data Engineering Skills1.5K
- Amee Joshi Data Engineering Portfolio1.5K
- Analytics Tracking Automation1.5K
- Data Engineering Medallion Pipeline1.5K
- Data Engineering Study Material1.5K
- Employee Performance Analytics Hr1.5K
- Enterprise Data Engineering Pipeline Ssis Pyspark1.5K
- Harvard Art Museum Data Pipeline1.5K
- Harvard Art Museum Etl Analytics1.5K
- Harvard Art Museums Data Pipeline1.5K
- Harvard Art Museums Etl Analytics1.5K
- Harvard Artifacts Data Engineering Analytics1.5K
- Harvard Artifacts Data Engineering App1.5K
- Harvard Artifacts Data Engineering Pipeline1.5K
- Harvard Artifacts Etl Analytics1.5K
- Llm Intelligent Public Opinion Analytics1.5K
- Options Analytics Agent Langgraph1.5K
- Realtime Cinema Data Engineering Pipeline1.5K
- Harvard Artifacts Collection Analytics Pipeline1.4K
- Harvard Artifacts Collection Data Engineering1.4K
- Harvard Artifacts Collection Data Engineering Analytics1.4K
- Harvard Artifacts Collection Etl Analytics1.4K
- Harvard Artifacts Etl Streamlit Analytics1.4K
- Harvard Art Museums Data Engineering App1.3K