πŸ“ Subsystem Deep Dive

utils/computerUse/

πŸ“ utils/computerUse/ πŸ“„ 7 files

Tutorial: computerUse

The project enables an AI model to control a computer by translating high-level intents (like clicking or typing) into low-level OS events on macOS. It integrates this capability via an MCP Server, manages concurrency with session locking, and ensures user safety through a dedicated abort hotkey. A host adapter bridges the generic computer-control logic with the specific CLI environment, while a rendering layer formats tool activities for the terminal user interface.

flowchart TD A0["The Executor (Computer Control)"] A1["Host Adapter"] A2["MCP Server Integration"] A3["Session Locking (Concurrency Control)"] A4["Safety & Abort Mechanism (Esc Hotkey)"] A5["Tool Rendering"] A1 -->|"Instantiates and exposes"| A0 A2 -->|"Uses for configuration"| A1 A0 -->|"Notifies of simulated Escape"| A4 A2 -->|"Checks lock for tools"| A3 A5 -->|"Formats tool output"| A2

Chapters

  1. MCP Server Integration
  2. The Executor (Computer Control)
  3. Safety & Abort Mechanism (Esc Hotkey)
  4. Host Adapter
  5. Session Locking (Concurrency Control)
  6. Tool Rendering

Generated by Code IQ

Files in this section