stablyai avatar

Computer Use

Gives Claude direct control over your desktop apps through Orca's accessibility API. You can list running apps, read their UI state, click buttons, fill fields, press keys, and scroll, all through a CLI that returns JSON plus screenshots. Designed for the snapshot-act-snapshot loop: grab the current state, pick an element by index, perform one action, then check what happened before deciding the next move. Works best with native apps that expose rich accessibility trees. Electron and web-view-heavy apps often need the screenshot more than the tree. The action model prefers semantic operations like set-value over raw typing, which matters because keyboard input can fail silently when focus isn't where you think it is. Refreshing state between actions isn't optional since element indexes go stale after almost any UI change.

skills.sh installs
241.6K
GitHub stars
120.6K
last updated
Aug 21, 2026

Install

$ npx -y skills add stablyai/orca --skill computer-use --agent claude-code

Installs into .claude/skills of the current project.

Files

Gives Claude direct control over your desktop apps through Orca's accessibility API. You can list running apps, read their UI state, click buttons, fill fields, press keys, and scroll, all through a CLI that returns JSON plus screenshots. Designed for the snapshot-act-snapshot loop: grab the current state, pick an element by index, perform one action, then check what happened before deciding the next move. Works best with native apps that expose rich accessibility trees. Electron and web-view-heavy apps often need the screenshot more than the tree. The action model prefers semantic operations like set-value over raw typing, which matters because keyboard input can fail silently when focus isn't where you think it is. Refreshing state between actions isn't optional since element indexes go stale after almost any UI change.

Browse the repository on GitHub

Sponsors

Details

Repository
github.com/stablyai/orca
Categories
Automation & Workflows, Design & UI/UX, CLI & Terminal
First seen
Jun 3, 2026

More from stablyai/orca

All 4
1inference-sh avataragent-toolsinference-sh/skillsRun AI apps via inference.sh CLI - image generation, video creation, LLMs, search, 3D, Twitter automation. Models: FLUX, Veo, Gemini, Grok, Claude, Seedance, Om213.7Kskills.sh installs
2mattpocock avatardesign-an-interfacemattpocock/skillsGenerate multiple radically different interface designs for a module using parallel sub-agents. Use when user wants to design an API, explore interface options,208.8Kskills.sh installs
3tt-a1i avatararchifytt-a1i/archifyCreate polished, validated architecture, workflow, sequence, data-flow, and lifecycle/state diagrams as explorable standalone HTML with inline SVG, dark/light t190.4Kskills.sh installs
4agentspace-so avatarnano-banana-editagentspace-so/runcomfy-agent-skillsBatch image editing with identity preservation, background swaps, and spatial localization via Google Nano Banana 2.176.4Kskills.sh installs
5vyralcontent avatarviral-short-formvyralcontent/content-skillsBrainstorm and write high-retention short-form video and carousel content for TikTok, Reels, and YouTube Shorts. Use whenever someone wants viral hook ideas, a 133Kskills.sh installs
6coreyhaines31 avatarsales-enablementcoreyhaines31/marketingskillsWhen the user wants to create sales collateral, pitch decks, one-pagers, objection handling docs, or demo scripts. Also use when the user mentions 'sales deck,'126.7Kskills.sh installs