Skip to content

Commit 15edeec

Browse files
cameroncookecodex
andcommitted
docs: Update UI automation changelog
Record the runtime snapshot and next-step guidance improvements for the upcoming release. Co-Authored-By: Codex <noreply@openai.com>
1 parent 7d1c713 commit 15edeec

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@
88
- Added `snapshot_ui sinceScreenHash` / CLI `--since-screen-hash` so callers can skip full runtime snapshot output when the screen hash is unchanged.
99
- Added `batch` for executing multiple AXe UI automation steps in one simulator session.
1010
- Added `wait_for_ui` for polling rs/1 runtime UI snapshots until UI predicates such as existence, enabled state, focus, text, or settled layout are satisfied. `textContains` can also wait on visible text without a selector when the match is unique.
11+
- Added structured rs/1 element-ref `batch` tap steps, preserved same-screen refs after successful `tap` and `batch` actions, and improved UI automation guidance and next steps for one-observation interactions. Validated the flow with a source-built AXe binary and the full Weather/Safari Claude Code task, with no raw-string batch attempts.
1112

1213
### Fixed
1314

@@ -52,6 +53,10 @@
5253
- Fixed runtime snapshot tips so compact output names all target-ref action tools, including `long_press` and `touch`.
5354
- Clarified key press and key sequence tool descriptions so agents know key codes are AXe/macOS virtual key codes and should prefer `type_text` for text entry.
5455
- Clarified `wait_for_ui` timeout recovery hints so agents know selector fields match exact values and should use `textContains` for partial visible text.
56+
- Fixed UI action success next steps so agents are prompted to refresh runtime snapshots before reusing element refs after actions such as swipes.
57+
- Fixed `snapshot_ui` next-step guidance so state-changing controls such as segmented units and switches remain available in targets without being promoted as generic tap or batch suggestions.
58+
- Fixed `snapshot_ui` tap next-step priority so content-rich cards are suggested before navigation controls like Settings.
59+
- Fixed successful UI action results so they include a fresh runtime snapshot and actionable next steps, reducing follow-up refresh calls after taps, typing, swipes, and batches.
5560

5661
## [2.5.2]
5762

@@ -689,4 +694,3 @@ Please note that the UI automation features are an early preview and currently i
689694
- Initial release of XcodeBuildMCP
690695
- Basic support for building iOS and macOS applications
691696

692-

0 commit comments

Comments
 (0)