Haptic technology to improve mobile app accessibility

Tencent Holdings is a technology and entertainment company from China that has developed ‘MTGPA Haptics’, a technology that transmits vibro-tactile signals to its users and can be used for notifications or as an orientation aid. By 2022, MTGPA Haptics had been installed in over 240 million smart phones.

Tencent Holdings Ltd. is a multinational technology and entertainment company headquartered in Shenzhen, China. Originating from Tencent´s game development, MTGPA (Magic Tencent Game Performance Amelioration) Haptics is transmitting vibro-tactile signals to the user, which support orientation and notification. Typical customers are persons with visual impairments and the elderly. Connected to the Tencent Map app, MTGPA Haptics guides customers indoors and outdoors through long and short vibrations in case of deviations from the planned route.

Problems Targeted

More and more persons with visual impairments rely on technical support for navigation and notification. Thus, precise commands and indoor and outdoor availability are essential.

Solution, Innovation and Impact

Initially working with a pilot group of 30 visually impaired users, the company evaluated and verified the vibro-tactile information features. One result was that visually impaired persons outperformed persons without impairment in terms of recognizing vibro-tactile information. MTGPA Haptics, therefore decided to develop a toolbox that gives vibro-tactile feedback to the user. It works like the vibration function on a smart phone and can be installed on more than 200 models of devices, such as mobile phones and tablets, and is compatible with both iOS and Android. Originally developed as a feature to make games more exciting, its use has been extended to support persons who are blind or visually impaired and the elderly. Moreover, the patterns work in public settings without interfering with the environment, transmitting information only to the user. As a navigation feature, users get different haptic signals, like long and short vibrations, when deviating from their chosen route. No signal means that they are right on track. Tencent does not publish actual user numbers, but in 2022 MTGPA Haptics has been installed some 240 million times worldwide.

Funding, Outlook and Transferability

Tencent plans to further develop haptic features for games and other features, making it a standard element in human and IT interaction. In the coming years, the company will work on such issues as online learning, information services, employment, living assistance, work assistance, and financial services, and will provide haptic feedback solutions for all users. In cooperation with the Tencent map and Sogou input method team, the company plans to further improve the vibro-tactile features with a redesigned orientation map, making the navigation feature even more accessible and easier to use.

Pictures