Technologies available for licensing, investment, joint ventures and R&D contracts in Ukraine, Azerbaijan, Georgia, Moldova, Uzbekistan

Frontpage Slideshow (version 2.0.0) - Copyright © 2006-2008 by JoomlaWorks

Google Translate

Patenting Information

Tag Cloud



Free counters!

Home Biotechnologies Software technology of virtual communication for people with hearing or seeing disabilities

Software technology of virtual communication for people with hearing or seeing disabilities

Description

The new outstanding software technology of virtual communication using Ukrainian sign language has been created. It contains the alphabet of dactyl signs, a text-to-speech subsystem for Ukrainian language, virtual human model with detailed arms and head capable of reproducing any movement or gesture. The multimedia application can be a built-in part of a modern operation system.

Commercial value of the obtain results is an opportunity to distribute the software to the boarding schools for children with hearing disabilities, during education of sign language teachers and translators, in various organizations of Ukraine wherever usage of sign language is appropriate.

Innovative Aspect and Main Advantages

Innovative side of the work is the usage of animated 3d virtual human for reproduction of signs as opposed to static photos or videos. This approach extends the teaching capabilities of the sign language learning system because of the following features: playing gesture frame-by-frame, looking from different angles; thus, having all the nuances of a sign reproduction.

For the creation of the system Motion Capture technology has been used, which allows to get digital representation of a gesture from a real-world human. Thus, the gestures obtained look very natural. This gives a path to the standard of the sign language.

Innovative side of methods and algorithms of lips detection and recognition gives a new way to teaching proper articulation to both good- and bad-hearing people. The suggested interactive technology gives feedback on the quality of articulation.

Areas of Application

The suggested software can be used in the following domains:

  • Education – for the teaching process for children with hearing disabilities, for education of stuff who will work with deaf people;
  • Economics – for enterprises and organizations which have workers with hearing disabilities (in order to facilitate communication with other workers);
  • Internet technologies – for creation of websites with content presentable for disabled people;
  • Culture – for creation of sign language translation of written art.

Among associations interested in the result are: Ukrainian society of deaf people, Ministry of Education of Ukraine, TV channels etc.

Application for sign language modeling
Fig. 1 Application for sign language modeling

Application for lips reading during pronunciation
Fig. 1 Application for lips reading during pronunciation

Stage of Development

Software for sign language modeling of sign language has been already tested and is ready for demonstration of usage.

Contact Details

Contact person: Krak Iurii Vasylyovych
Glushkov Institute of Cybernetics NAS Ukraine
Address: 03680, Kyiv, Glushkov avenue, 40
Tel: +38044 5262008
Fax: +38044 5267418
E-mail: This e-mail address is being protected from spambots. You need JavaScript enabled to view it

Add comment


Security code
Refresh

For additional technologies go to: http://www.stcu.int