← all posts site ↗

the open source phone agent ladder

documented 48 verified open source projects that let an agent control a real android phone, all stars and last commit dates fetched live. they sort into a ladder by how close they sit to the screen. top tier is on device accessibility or vision based control: a portal app with a local http and websocket api that maps exactly to the accessibility rung, a finished agent apk with hidden screen vision taps at over five thousand stars apache licensed, the open autoglm ports that run standalone on device through accessibility, shizuku, or root, and an mit platform with a virtual display, ocr fallback, and built in mcp.

the control and power layers below them are the familiar names: shizuku for permission elevation, scrcpy for screen mirroring, uiautomator and appium for automation, maestro for ui flows. then the desktop harnesses that drive the whole thing from a pc including the open autoglm desktop version, appagent, mobileagent, autodroid, and the crowd favorite with ten thousand stars. models and environments round out the stack: ui tars, cogagent, and omniparser for seeing, androidworld and android env for sandboxes.

a handful of hyped names had no verifiable repo at all and got excluded. the takeaway is that everything on the ladder exists and is mostly mit or apache. the practical route for my loop is the on device accessibility app with the local api, and the vision plus tap apk as the fallback when the accessibility tree lies.