Provide real-time translation of speech to sign language
People who are deaf need a text transcription or sign language version to fully understand sign language. Since many people are most comfortable communicating in sign language, this feature would help them by translating speech to automatically-generated sign language for live video feeds, streaming audio, and other multimedia content.
Discussion by Disabilities
Deaf and Hard of Hearing
This feature would greatly increase the ability of some people who are deaf to quickly and fully understand spoken content.
Related Research and Papers
- Providing signed content on the Internet by synthesized animation – University of East Anglia, UK – Kennaway, J.R., Glauert, J.R., and Zwitserlood, I. (2007)
- American Sign Language natural language generation and machine translation – University of Pennsylvania – Huenerfauth, M. (2005)
- MobileASL:: intelligibility of sign language video as constrained by mobile phone technology – University of Washington – Cavender, A., Ladner, R.E., and Riskin, E.A. (2006)
- IBM’s “Say It Sign It” – IBM Research, University of East Anglia (2007)
- DePaul ASL Project – DePaul University
- Animating Sign Language: The eSIGN Approach – University of Hamburg (2004)