AiPC
Give the agent "this" and he gets a real PC.
Screen, mouse, keyboard, your browser, files, terminal, SSH — via the model's native tools.
RU README: Russian version · Skills: SKILL.md · IDE matrix: docs/IDES.md
Contents
- What it is
- Why AiPC
- Read this first: risks
- Quick start
- The
aipcmenu - 70 tools
- Token efficiency
- MCP connection
- Self-update
- Safety
- What can go wrong
- Troubleshooting
- Project structure
- Build from source
- License
What it is
AiPC is a local service + console utility that gives any AI agent full access to your computer over the open MCP (Model Context Protocol) standard.
[ Agent in any IDE ] --MCP/stdio--> [ AiPC-Core: one local service ]
|
+------------------+----------------+------------------+
| | | |
Vision Control Browser System/Net
screenshots, mouse+keyboard, your Chrome via files, terminal,
UI tree, apps, CDP + history, processes, SSH,
windows clipboard JS eval search, sysinfo
The agent stops being "text in a chat" and starts working like a human at the PC: it looks at the monitor, clicks, types, opens apps, googles in your browser, runs commands, uses SSH — and verifies every step with a new screenshot.
If a model says "I have no computer access", the built-in system prompt
(aipc/server.py:SYSTEM_PROMPT, also served as the aipc_instructions MCP prompt)
tells it to use the tools when they are available — or honestly say what's missing.
Why AiPC
| Usual agent limits | With AiPC |
|---|---|
| Blind: no screen | screen_see — screenshot as a native image block, cursor marked |
| Clicks by guessing | ui_snapshot / ui_find — ready-made x/y coordinates (0–1000) |
| Typing into the void | focus_type — verified focus + atomic typing; refuses to type blind |
| Sleeps and hopes | wait_for_window / wait_for_ui_element / wait_for_change |
| "Did it work?" unknown | screenshot_diff, assert_ui, logs_tail, audit.log |
| No machine access | Files, terminal, processes, SSH/SFTP, browser, clipboard |
| Token burn on screenshots | Native image blocks (~65 chars + image vs 55K chars of base64) |
Read this first: risks
AiPC gives an AI model real control over your PC: it sees the screen, moves the mouse, types, runs terminal commands, reads files, uses SSH. That is the point — and the risk.
- Keep the default
askmode: the server shows you a Yes/No dialog for every dangerous action. The model cannot click "Yes" for you. - Never switch to
autofor tasks involving strangers' files, links or email attachments — prompt injection is real (seedocs/THREAT_MODEL.md). - Know the kill switch:
aipc panicor Ctrl+Alt+Shift+K freezes everything. - This tool is for your own machine (see the note at the top).
From the project's README.