Skip to content

Record a demonstration and turn it into a reusable iPhone intent

An intent is a task you saved so you can run it again. It has a name, an instruction, an optional checklist, and the steps that worked last time. Run it from My intents on the Agent tab, or with Siri, Shortcuts, widgets, and Control Center.

Tap the record button at the top right of the Agent tab (New intent). You have two choices.

Do the task yourself while the board watches the mirrored screen.

  1. Make sure the board is connected, Screen Mirroring is on, and a model is set up.
  2. Choose Record me doing it. Go to the Home Screen. Recording starts when the 5-second countdown in the Dynamic Island ends.
  3. Do the task at a normal pace.
  4. Stop in the app or in the Dynamic Island.

The board can’t see your fingers, so the steps are worked out from how the screen changed. Steps it is unsure of are marked yellow. Check them before you save. Turning a recording into steps uses your own AI service; the free AI service in the app only runs tasks.

If recording stops early, for example because the app ran too long in the background, return to the app. The unfinished recording waits on the Agent tab: create the draft again, or discard it.

Ran a task that went well? Choose Save last run as intent to keep it. When a run finishes, the Agent tab also offers Save as intent.

Open an intent to see its Instruction, Steps, and Checklist. Tap Edit to change the name, instruction, or checklist. The checklist is given to the agent as hints every time the intent runs.

Recorded moves run without the AI while the screen matches what was recorded. If a step needs judgement, swipe it and choose Let AI do it. Use Add step for more:

Step What it does
AI step Hand one part of the task to the AI, in your words.
Read from the screen Copy information off the screen into the run’s notebook.
Copy the notebook Put what was read on the clipboard, ready to paste.
Ask me to do a step Stop and ask you to do something by hand, then go on.

Repeat until runs the steps again until a condition is true on screen, for at most a set number of rounds (5 by default).

Use Review Demonstration or Review Last Run to compare the steps with what happened, and Run to try it.

When a run ends with an answer, such as a price or a list it looked up, Runs shows it in a Result card above the steps. The card is collapsed to one line; tap it to read the whole text, and tap Copy to copy it.

Some steps should wait for you. In Settings → Runs → Ask me first, choose:

Setting The agent stops and asks before
Payments only (default) Paying, buying, or transferring money.
Payments, sending, deleting Also sending a message, posting, deleting, or changing account settings.
Never Nothing. It doesn’t stop to ask.

It asks in a notification: press and hold it to answer.

  • Export and import. In My intents, use the menu for Import… and Export All…, or export one intent from its page. Intents travel as .esp32intent files through AirDrop or Files, and Handsy CLI reads the same format.
  • Send one to us. You can share a useful intent by mail. Screenshots are blurred first, and we use it only to improve intents.

Before saving or sharing intents that touch personal accounts, read the privacy policy. New to the app? Start with Using the app.