Guides
What it takes to automate an iPhone without a jailbreak
iOS does not give an app a way to tap and swipe inside other apps. People still automate iPhones without a jailbreak. The ways below are the ones this site’s docs actually describe, plus Shortcuts, which the ESP32 Agent app can call. Each row is what you have to set up, what that path is good at, and where it stops.
Five ways
| Way | What you need | What it’s good at | Where it stops |
|---|---|---|---|
| Shortcuts | An iPhone. No extra hardware and no jailbreak. A saved ESP32 Agent intent can also be started from Shortcuts, Siri, widgets, or Control Center. | Actions an app already exposes. A saved Handsy task can be started again without opening the app first. | It cannot tap an arbitrary spot in some other app. iOS does not offer that to apps. |
| WebDriverAgent / XCUITest | A Mac with Xcode. On the phone: Developer Mode, and WebDriverAgent installed and trusted. A paid Apple Developer Program membership, or a free Apple ID whose signing expires every 7 days. No jailbreak. | UI tests on a real iPhone, or on the Simulator. The runner lives on the Mac. | You rebuild and re-sign WebDriverAgent when Xcode or iOS changes. The site’s solutions notes say this stack breaks when the UI shifts. |
| Bluetooth HID | Not the current installer. The legacy branch documents Bluetooth HID board variants. The current app and the browser installer use a USB mouse and keyboard. | These docs don’t list a separate benefit. They don’t tell you to set this up. | Legacy firmware is not interchangeable with the firmware the installer writes. The variant notes live in that branch’s README. |
| USB HID (Handsy / ESP32) | A standard Seeed Studio XIAO ESP32S3 (8 MB flash, 8 MB PSRAM), an iPhone XS or newer on iOS 18, and a short USB-C data cable. Lightning phones add a Lightning to USB Camera Adapter. Chrome or Edge once, to flash. AssistiveTouch on, and Screen Mirroring to ESP32 Agent. No jailbreak and no Apple developer account for daily use. | A real iPhone. The board is a normal USB keyboard and mouse, so a click is a tap and a drag is a swipe. The ESP32 Agent app can run the task on the phone. Claude Code, Codex, OpenClaw, and other MCP clients can drive the same board through Handsy CLI. | The phone stays unlocked and in portrait. iOS does not mirror passcode entry, Apple Pay, or DRM-protected video. A USB-C iPhone cannot charge by wire while the board is plugged in. You flash this board yourself. The Handsy device is a different product and is not for sale yet. |
| Screen mirroring on a computer | The legacy setup runs UxPlay on a computer. The phone and the computer share a network, and the ESP32 talks to that computer over Wi-Fi. Current Handsy still uses AirPlay Screen Mirroring, but the receiver is on the board, not on the computer. | You can watch the phone on the computer. That is how the original project worked. | The computer stays on for the whole task. Legacy firmware does not match the current installer. These docs don’t describe an HDMI KVM for an iPhone. |
USB HID, in the current project
The board plugs into the phone and shows up as a USB keyboard and mouse. With AssistiveTouch on, the pointer’s click is a tap. The phone mirrors its screen to the board over the board’s own Wi-Fi. An AI looks at that picture and sends the next tap. No jailbreak.
Two ways to decide the next tap. The ESP32 Agent app does it on the phone after a one-time firmware install. Or an agent on your computer uses Handsy CLI and the local MCP server esp32agent mcp. That server is what Claude Code, Codex, and OpenClaw attach to. OpenClaw’s published skill is on ClawHub as handsy.
If you want to try it
The open-source board is flashed from the install page. The plug-and-play unit is separate: join the Handsy device waitlist. It is not for sale, it has no final price, and joining the list is not an order. Early birds may get a unique invite code.
Related: where to buy a XIAO ESP32S3 · iPhone MCP server · OpenClaw on an iPhone · Hardware and buying