Generate or retrieve a text alternative for audio/multimedia content

This feature includes transcription and gathering of text alternatives to multimedia content. This feature may be implemented in several ways:

  • Automatic computerized transcription or captioning (voice-to-text) of audio, including live feeds, microphone input, and recorded media
  • Retrieving existing transcripts or captions from other sources and linking them to the current media (e.g. a video of a presidential address may not be captioned, but is likely to have a transcript posted on a news website that can be presented to the user)

Discussion by Disabilities (Benefits & Preferred Behaviors)

Deaf and Hard of Hearing

Captions and transcripts allow people who are deaf or hard of hearing to understand the same media as their hearing peers, in real-time

Cognitive, Language, Learning Disabilities & Low Literacy

  • Captions and transcripts may assist with language understanding for people with cognitive, language, and learning disabilities.
  • Captions can also serve as a teaching tool for people with literacy problems who are learning to read a known language.

Existing Products

Please note that these products are not necessarily endorsed by RtF, but represent the range of available options.

Related Research and Papers

Subtitled and captioned videos

Floe video player, with frame and caption preview on hover over the scrub bar.

Video Content and Learning

Video as a learning medium has become increasingly popular on the web. Many sites now even cater solely to video learning content (e.g., Academic Earth, TED Talks, Khan Academy). With the use of video as a compact and compelling medium, however, comes the responsibility of making it an effective platform for users with a myriad of different needs and preferences.

Audio player with captions and structured transcript

Audio Content and Learning

Audiobooks, podcasts, and lecture recordings are a popular way of delivering learning content. However, it is somewhat rare to find captions or transcripts for such content. The Audio Content and Learning guide on the Inclusive Learning Design Handbook covers topics such as enhancing audio with multiple modalities, and provides a possible design for an inclusive audio player.


by roman01la

Accessible HTML5 Video player React component