A brand new hands-free AI-powered gaming mouse

Mission Gameface is a brand new open-source hands-free gaming mouse that permits individuals to manage a pc’s cursor utilizing their head motion and facial gestures. Individuals can elevate their eyebrows to click on and drag, or open their mouth to maneuver the cursor, making it doable for anybody to pursue gaming.

The venture was impressed by the story of quadriplegic online game streamer Lance Carr, who lives with muscular dystrophy, a progressive illness that weakens muscle tissues. Lance refused to let his bodily limitations maintain him from his love of gaming, so he used a head-tracking mouse to manage his cursor. In 2021, Lance’s home caught on fireplace whereas he was gaming one evening — and it was all caught on a live stream and watched by players across the globe. Lance misplaced all of his on-line gaming tools within the fireplace, together with the costly head-tracking mouse, which is the first know-how that enabled him to play laptop video games.

After listening to Lance’s story, we knew we had to assist. So we labored with Lance to co-design Mission Gameface, a hands-free gaming mouse that makes use of Google MediaPipe open-source options. Head actions and facial gestures captured merely from a webcam are acknowledged by machine studying fashions to maneuver the cursor accordingly. To adapt to the wants of various customers, we integrated the concept of a gesture measurement, which permits customers to manage how outstanding their gesture must be to set off a mouse motion.