The Sign Language Avatar Project

SiMAX is a semi-automatic system designed to translate text into sign language by combining technology from animation pictures, the gaming industry, and computer-aided translation services. As a fully automatic translation is not possible, the translation process is managed by a professional, deaf person.

Problems Targeted

Currently, most information - both written and oral – is not accessible to many deaf people as 80% of them are functional illiterate. SiMAX is able to translate a large amount of information into sign language faster than conventional video production, and therefore it is also more cost-effective. Thus, we expect a high demand especially from public authorities.

Solution, Innovation and Impact

SiMAX is a semi-automatic system designed to translate text into sign language by combining technology from animation pictures, the computer gaming industry, and computer-aided translation services. As a fully automatic translation is not possible, the translation process is managed by a deaf person who is preferably a qualified interpreter or has an excellent command of sign language. As such, this system also creates high-quality jobs for deaf people. The translation process is conducted by a person who is knowledgeable in sign language, which includes people with a hearing impairment, and as such, this system also creates high-quality jobs for this group. Because a fully automatic translation is not possible, there is a need for a human interpreter. However, there are exceptions, such as the standardized texts that are used for service announcements on public transportation systems. SiMAX can be used for translating these announcements in public areas, including security alerts. The system follows the natural grammar principles while developing the sign language avatar. Mimic has a grammar function in sign language (e.g., raised eyebrows symbolize an interrogative sentence), which the avatar is capable of displaying. The figure shows emotion and can move its head and upper body fluently. The avatar is exchangeable according to the target group e. g. for a children’s broadcast the avatar has the appearance of a child. A “learning machine” is integrated into the system, which saves all previously performed translations and keeps them ready as proposals for future translations.

Funding, Outlook and Transferability

SiMAX will start by translation of TV and internet content in big markets like the US and Germany. Once established there it will also expand to smaller markets like Switzerland and Portugal. Then it will also offer special applications like the translation of package leaflets of medicines. For deaf people the system will be available for free as web application to use it as additional communication tool for private purposes.

Pictures