An Assistive Technology Framework for Communication with Hearing Impaired Persons
Abstract
This paper presents a novel assistive technology framework which provides an interface to support communication between hearing impaired person and ordinary person over the mobile phone. It converts the ordinary person's voice to text and afterward text to tactile feedback at the hearing impaired person’s end. The Morse Code tactile feedback have been identified as the most appropriate method for providing the tactile feedback at the hearing impaired person’s end, since it is a standard code which helps persons with impairments. The work addresses the challenge of using a set of Morse Code shorthand vibration patterns to translate the whole text message to tactile feedback to provide a simple, efficient and synchronous communication, rather than vibrating each and every character in text using
Morse Code characters. The user evaluation found that, most hearing impaired persons’ preferred method of conversation is the Morse Code shorthand forms with two or three character length rather than reading the entire text message. Due to less perspicuity of a hearing impaired person’s voice, the study comes up with the conversion of the hearing impaired persons’ voice to text and sends it to the ordinary person synchronously as a voice reply. The results of the evaluation experiment shows that the assistive technology framework facilitates by improving the quality of communication of hearing impaired persons over a mobile device.
Keywords
Full Text:
PDFReferences
M. Baker, “Opportunity blocked: the employment experiences of deaf
and hard of hearing people,” London R. Natl. Inst. Deaf, 2006.
“Definition and Accommodations for Hearing Impairments.”
[Online]. Available: http://ada.ky.gov/hearing_imp_def.htm.
P. Ladd, Understanding Deaf Culture: In Search of Deafhood.
Multilingual Matters, 2003.
“Those of Us DisLabeled: A Guide to Awareness and
Understanding.” [Online]. Available:
http://www.hdi.uky.edu/Media/Default/Documents/DisLabeled.pdf.
C.-M. Wu, C.-H. Luo, S.-W. Lin, S.-C. Chen, M.-C. Hsieh, C.-T.
Chao, and C.-C. Tai, “Morse Code Recognition System with
Adaptive Fuzzy Algorithm for the Disabled,” J. Med. Biol. Eng., vol.
(4), pp. 205–210, Nov. 2000.
Z. Zafrulla, J. Etherton, and T. Starner, “TTY phone,” in Proceedings
of the 10th international ACM SIGACCESS conference on
Computers and accessibility - Assets ’08, 2008, p. 277.
M. Glaser and D. Aarons, “TELECOMMUNICATIONS BRIDGING
BETWEEN DEAF AND HEARING USERS IN SOUTH AFRICA.”
A. Cavender, R. E. Ladner, and E. A. Riskin, “MobileASL:
Intelligibility of Sign Language Video as Constrained by Mobile
Phone Technology,” in Proceedings of the 8th international ACM
SIGACCESS conference on Computers and accessibility - Assets ’06,
, pp. 71–78.
J. Brunson, “Visually Experiencing a Phone Call: The Calculated
Consumer Labor Deaf People Perform to Gain Access through Video
Relay Service,” Disability Studies Quarterly, vol. 30, no. 2. .
M. Mirzaei, S. Ghorshi, and M. Mortazavi, “Helping deaf and hardof-
hearing people by combining augmented reality and speech
technologies,” In Proc. 9th Intl Conf. Disability, Virtual Reality &
Associated Technologies, 2012. [Online]. Available:
http://www.icdvrat.org/2012/papers/ICDVRAT2012_S05N2_Mirzaei
_etal.pdf.
S. Cox, M. Lincoln, J. Tryggvason, M. Nakisa, M. Wells, M. Tutt,
and S. Abbott, “TESSA, a system to aid communication with deaf
people,” 2006.
C.-H. Yang, “An interactive morse code emulation management
system,” Comput. Math. with Appl., vol. 46, no. 2–3, pp. 479–492,
Jul. 2003.
“Arduino Morse Code generator - Electronics Blog.” [Online].
Available: http://www.electronicsblog.org/arduino-morse-codegenerator/.
C. H. Yang, L. Y. Chuang, C. H. Yang, and C. H. Luo, “Morse Code
Application for Wireless Environmental Control Systems for
Severely Disabled Individuals,” IEEE Trans. Neural Syst. Rehabil.
Eng., vol. 11, no. 4, pp. 463–469, 2003.
C.-H. Yang, C.-H. Luo, Y.-L. Jeang, and G.-J. Jon, “A novel
approach to adaptive Morse code recognition for disabled persons,”
Math. Comput. Simul., vol. 54, no. 1–3, pp. 23–32, 2000.
“267 Morse Code acronyms and abbreviations.” [Online]. Available:
http://www.allacronyms.com/morse_code/abbreviations.
“Accessing Google Speech API / Chrome 11 | mike pultz.” [Online].
Available: http://mikepultz.com/2011/03/accessing-google-speechapi-
chrome-11/.
“Google Speech API – Full Duplex PHP Version | mike pultz.”
[Online]. Available: http://mikepultz.com/2013/07/google-speechapi-
full-duplex-php-version/.
“FLAC - Free Lossless Audio Codec.” [Online]. Available:
https://xiph.org/flac/.
Refbacks
- There are currently no refbacks.