Computer-Use (Desktop + Android)

Env VarDescriptionDefault
COMPUTER_USE_ENABLEDEnable computer-use and Android ADB toolsfalse

Or in ~/.tota/tota.yaml:

capabilities:
  computer:
    enabled: true

Enable via wizard: tota setup computer

#Desktop tools (macOS, Linux, Windows)

Uses @nut-tree-fork/nut-js. On Linux, first run sudo apt install libxtst-dev.

ToolDescription
computer_screenshotCapture the full screen or a region
computer_seeScreenshot + vision AI analysis in one step
computer_clickLeft, right, or double-click at (x, y)
computer_moveMove cursor to (x, y)
computer_typeType text at the current keyboard focus
computer_keyPress a key or combo (cmd+c, ctrl+z, enter, etc.)
computer_scrollScroll at a position
computer_dragClick and drag between two coordinates
computer_screen_sizeGet display resolution

#Android tools (ADB)

Requires adb in your PATH and a connected device or emulator.

ToolDescription
adb_devicesList connected Android devices
adb_screenshotTake a screenshot of an Android device
adb_seeAndroid screenshot + vision AI analysis
adb_tapTap at (x, y) on the device
adb_swipeSwipe between two points
adb_typeType text into the focused field
adb_keySend key event (3=HOME, 4=BACK, 66=ENTER…)
adb_shellRun any adb shell command
adb_pullPull a file from the device
adb_pushPush a local file to the device