github avatar

Automate This

You record yourself doing something tedious on your computer, hand over the video file, and this skill extracts frames and audio to figure out what you're actually doing step by step. It then proposes automation at three levels: a quick shell alias or AppleScript for the worst part, a full standalone script that handles the whole workflow, and finally a scheduled version with logging and error handling. What's smart here is that it fingerprints your environment first, checking what you already have installed (Python, Node, Playwright, etc.) so it only suggests automation using tools you can actually run. It won't propose some elaborate Selenium setup if you just need a curl command. The tiered approach means you can get a win in five minutes instead of abandoning the whole thing because full automation feels like a project.

skills.sh installs
2.3K
GitHub stars
41K
last updated
Aug 21, 2026

Install

$ npx -y skills add github/awesome-copilot --skill automate-this --agent claude-code

Installs into .claude/skills of the current project.

Files

Automate This

Analyze a screen recording of a manual process and build working automation for it.

The user records themselves doing something repetitive or tedious, hands you the video file, and you figure out what they're doing, why, and how to script it away.

Prerequisites Check

Before analyzing any recording, verify the required tools are available. Run these checks silently and only surface problems:

command -v ffmpeg >/dev/null 2>&1 && ffmpeg -version 2>/dev/null | head -1 || echo "NO_FFMPEG"
command -v whisper >/dev/null 2>&1 || command -v whisper-cpp >/dev/null 2>&1 || echo "NO_WHISPER"
  • ffmpeg is required. If missing, tell the user: brew install ffmpeg (macOS) or the equivalent for their OS.
  • Whisper is optional. Only needed if the recording has narration. If missing AND the recording has an audio track, suggest: pip install openai-whisper or brew install whisper-cpp. If the user declines, proceed with visual analysis only.

Phase 1: Extract Content from the Recording

Given a video file path (typically on ~/Desktop/), extract both visual frames and audio:

Frame Extraction

Sponsors

Details

Repository
github.com/github/awesome-copilot
Categories
Git & Pull Requests, AI & Agent Building, Automation & Workflows, CLI & Terminal, Video & Audio Editing

More from github/awesome-copilot

All 318
1github avataracquire-codebase-knowledgegithub/awesome-copilotUse this skill when the user explicitly asks to map, document, or onboard into an existing codebase. Trigger for prompts like "map this codebase", "document thi2.3Kskills.sh installs
2github avatarnapkingithub/awesome-copilotVisual whiteboard collaboration for Copilot CLI. Creates an interactive whiteboard that opens in your browser — draw, sketch, add sticky notes, then share every2.3Kskills.sh installs
3github avatarcloud-design-patternsgithub/awesome-copilotCloud design patterns for distributed systems architecture covering 42 industry-standard patterns across reliability, performance, messaging, security, and depl2.3Kskills.sh installs
4github avatarcli-masterygithub/awesome-copilotInteractive training for the GitHub Copilot CLI. Guided lessons, quizzes, scenario challenges, and a full reference covering slash commands, shortcuts, modes, a2.1Kskills.sh installs
5github avatarspring-boot-testinggithub/awesome-copilotExpert Spring Boot 4 testing specialist that selects the best Spring Boot testing techniques for your situation with Junit 6 and AssertJ.2.1Kskills.sh installs
6github avatarcodeqlgithub/awesome-copilotComprehensive guide for setting up and configuring CodeQL code scanning via GitHub Actions workflows and the CodeQL CLI. This skill should be used when users ne2Kskills.sh installs