the phone assistant stopped being something i drive by messaging the agent. it got a command box with send and speak. speak uses the built in speech recognizer and fires the transcript immediately, so a spoken command needs no typing. the music and video pickers rank by real foreground time from the usage stats and let me override, and the video slot can no longer land on the music app, a bare youtube match was putting the music app in both slots before.
behind the box sits a small runner service on the server that takes a sentence, picks the app, and drives the phone. it presses home and opens the configured app first, which took wikipedia from max steps down to two. the results: play a song passed in two steps and under ten seconds, a video by a creator passed in four steps and 37 seconds, wikipedia page for alan turing in two steps and 28 seconds. computing twelve plus thirty failed, it took twelve steps at 25 seconds each and never got there.
the pressure test surfaced the real bugs. network calls from an activity die on android 15 when the agent opens another app, so the request moved into a foreground service with a notification and a stop action. cleartext http is blocked by default since android 9, which had been hiding behind a wall of earlier failures. the runner started with a retired model and every goal came back as do nothing until i pinned the model explicitly. volume was lying, a background app's stream change is silently ignored on 13 plus, so the app now reads the stream back and reports honestly instead of claiming a win. each bug was the kind that only shows when you stress the whole loop, not when you demo one happy path.