Computer Automation

web-infra-dev/midscene-skills

Lets you automate desktop apps through screenshots and natural language instead of hunting for DOM elements or accessibility IDs. Works across macOS, Windows, and Linux by literally looking at what's on screen, then clicking, typing, and navigating based on visual AI models like Gemini or Qwen. The workflow is strictly synchronous: take a screenshot, let the model figure out what to do, execute one action, repeat. It takes over your actual mouse and keyboard, so this is for native apps, Electron UIs, or anything that can't run headless. Web stuff should stick to their browser automation skill instead. Commands can be slow since each involves AI inference, and you need to configure vision model credentials upfront.

skills.sh installs

2.8K

GitHub stars

321

last updated

Aug 21, 2026

Sponsors

Promote your product hereReach 125k+ visitors monthlyPromote your product hereReach 125k+ visitors monthlyAgent CaffeineSponsoredClose your lid, come back to finished workSnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthlyWaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthlyknobsSponsoredSee your site on any phone, any day, in any language

Recommended

More Frontend Development

1designing-beautiful-websitestristanmanchester/agent-skillsDesigns UX/UI for websites and web apps: UX strategy, information architecture, user flows, wireframes, UI systems, component specs, and polished visual design.2.8Kskills.sh installs

2wpdsnexu-io/open-designWordPress Design System. Apply WordPress's official design tokens, typography, and component patterns to themes and sites.2.8Kskills.sh installs

3rive-interactivefreshtechbro/claudedesignskillsState machine-based vector animation with runtime interactivity and web integration. Use this skill when creating interactive animations, state-driven UI, anima2.8Kskills.sh installs

4animate-textpixel-point/animate-textCurated text animation catalog with exact JSON specs for headings, labels, counters, and text swaps. Use when an agent needs to pick or translate named effects 2.8Kskills.sh installs

5dt-obs-frontendsdynatrace/dynatrace-for-aiReal User Monitoring (RUM) on Dynatrace — web and mobile frontends. Core Web Vitals, user sessions, page performance, mobile crashes, frontend errors, and front2.8Kskills.sh installs

6social-medialangchain-ai/deepagentsDrafts engaging social media posts, writes hooks, suggests hashtags, creates thread structures, and generates companion images. Use when the user asks to write 2.7Kskills.sh installs