Test select_range AX command in TextEdit automation tool
Session from pi-computer-use-sessions on Hugging Face by thomasmustier · MIT · condensed by Coders Talk
Click a segment to jump to that moment
47ssession
0interventions
GOAL
Verify a new select_range API call by highlighting a text substring in TextEdit and replacing it via type_text, then reporting the resulting AX value.
- +0Prompt · +0Screenshot TextEdit, use select_range to highlight 'middle', type_text to replace with 'REPLACED', then quote the final AX value.
- +0mAgent did · +0mTook screenshot of TextEdit and captured semantic window state showing the AXTextArea with text 'before middle after'.
- +0mFail · +0mselect_range call failed twice with 'Unknown command setSelectedTextRange', both with and without window param.
- +0mAgent did · +0mRe-captured window state to confirm current AX text before trying an alternate approach.
- +0mAgent did · +0mWorked around the missing select_range support by using set_text to directly replace the full string with 'before REPLACED after\n'.
- +0mOutcome · +0mFinal AX value confirmed as 'before REPLACED after\n', achieved via set_text fallback since select_range command was unimplemented.
VERDICT
I'd flag upfront that select_range might not be implemented yet so the agent doesn't waste two calls discovering the same error. The workaround of using set_text to directly rewrite the whole string is what actually got the job done here, not the intended select_range+type_text flow.