Sidehand
Let AI agents operate Windows apps behind your window, without taking your mouse or keyboard.
- GitHub stars
- 2
- tools
- 3
- transport
- STDIO
- env var
- 1
- last updated
- Nov 8, 2026
Tools
3 toolsPublic tool metadata for what this MCP can expose to an agent.
ui_treethe window's controls as text, each with a ref (`e4`)
the window's controls as text, each with a ref (`e4`)
No parameter schema in public metadata yet.
ui_ocrtext of custom-drawn windows (games, Qt, canvas) via Windows OCR, with refs (`t1`) that `act` can click
text of custom-drawn windows (games, Qt, canvas) via Windows OCR, with refs (`t1`) that `act` can click
No parameter schema in public metadata yet.
ui_acttype, click, select, check, press, wheel, drag and more
type, click, select, check, press, wheel, drag and more
No parameter schema in public metadata yet.
Sponsors
Agent CaffeineSponsoredClose your lid, come back to finished work
SnugSponsoredThe clipboard manager for the AI eraPromote your product hereReach 125k+ visitors monthly
WaxSponsoredBlock anything with supervision, without erasing your iPhonePromote your product hereReach 125k+ visitors monthly
knobsSponsoredSee your site on any phone, any day, in any languageConfiguration
SIDEHAND_ALLOWOnly these windows can be read, operated or captured, e.g. Notepad;Contoso* (title parts or wildcards, separated by ;). Screen captures, launching apps and the clipboard are then off.
Readme
Sidehand logo
Sidehand
Your AI agent works in your Windows apps. You keep the keyboard.
Three AI agents fill in three apps hidden behind your note at the same time, while you keep typing in it
Sidehand lets Claude, Codex, Cursor or any MCP client read and operate Windows apps behind the window you are using. It types, clicks, picks from lists and reads the screen as text without moving your mouse or taking your keyboard.
Why Sidehand
Details
- Repository
- github.com/blue-b/sidehand
- Website
- github.com/Blue-B/sidehand
- Package
sidehand- Transport
- STDIO
- Registry
- MCP registry, active