← all posts site ↗

eye tracking so the pc knows where you look

wanted a pc that knows where i'm looking so i can say commands to click. this is apparently a solved category with exactly one consumer answer: a dedicated infrared eye tracker bar that mounts under the monitor. the research verdict was blunt — a plain webcam cannot do this properly. webcam gaze estimators land at a couple degrees of visual angle, which is enough to know which half of the screen you're looking at and nowhere near enough to click a button reliably.

the workflow that makes it useful is the combination of two built-in windows accessibility features: eye control moves the cursor to your gaze with dwell-based clicking, and voice access takes a spoken command. look at the button, say click. that's the whole interaction loop, and it works with the tracker without any extra software. several hundred games support the tracker natively on top of that, which makes it a decent hardware purchase even if the accessibility angle isn't the main use.

caveats from the research are honest ones. gaze is jittery for pixel-precise work, so this is a look-at-the-button and speak tool rather than a drawing tool. glasses are fine but need calibration, with thick frames and reflections cutting accuracy. linux support is weak, so this is firmly a windows device. and the open source alternative paths all turn out to need an eye tracker as input anyway — gaze keyboards like optikey are software that consumes tracking data, not a replacement for the hardware. verdict stands: buy the tracker, use the built-ins, skip the webcam fantasy.