Hands-free computer and gaming access via head tracking and facial gesture and speech

SensePilot is hands‑free software that uses a standard webcam and AI to track head movements and facial gestures for computer and gaming access. Co-designed with people with disabilities, it launched in May 2025, offers low-cost or free licenses, and is funded by grants and sales.

SensePilot, a startup company based in Vilnius, Lithuania, developed software that uses standard webcams for real-time head tracking and facial gesture and speech detection. The software enables users to operate computers and play video games entirely hands-free (though can also be used with joysticks and switches) without any additional or complex hardware. Launched after a hackathon event in May 2024, it was launched publicly in May 2025, and its user base quickly grew from 80 beta testers to about 200.

Problems Targeted

Persons with impairments of their arms or with no hand function cannot use standard input devices and computers, and cannot play digital games.

Solution, Innovation and Impact

The SensePilot is a software solution that was co-designed by people with disabilities and technical experts. Leveraging Artificial Intelligence, the system can use any standard webcam to track head motions and to recognize facial gestures and features, such as blinking, smiling, and raising eyebrows. This allows users to navigate software, communicate, and fully enjoy PC and gaming experiences hands-free. Its flexible settings overcome a wide variety of motion limitations, including those resulting from cerebral palsy, multiple sclerosis, and high-level spinal cord injuries. The software is compatible with multiple platforms and offers affordable or free licensing for schools and individuals. Its open architecture allows custom mappings for a vast range of programmes – from AAC (Augmentative and Alternative Communication) to word processors, and from web browsing to online multiplayer games. The software was developed within a Hackathon in May 2024 with a beta test involving 80 people located around the world, including end users, assistive technologists, and occupational therapists. A pilot programme in Ukraine involving soldiers with limb amputation as a result of the ongoing war was organized as well. Launched publicly in May 2025, SensePilot quickly reached over 200 users.

Funding, Outlook and Transferability

The rollout of SensePilot is funded through a combination of grants, public innovation challenges, and sales revenue. SensePilot is looking to add custom facial gestures, sound, and eye gaze as inputs in the future. To increase its reach, the start-up is seeking collaborations with government assistive technology services, charities, rehabilitation centres, hospitals, and school trusts. (#ZeroCall26)

Pictures

SensePilot uses standard webcams to track head movements and recognize facial gestures. 

SensePilot uses standard webcams to track head movements and recognize facial gestures. 

Select this picture Select this picture