AI TTS Smartphone App for Communication of Speech Impaired People

Lee, Hanyoung; Park, Deawoo

Due to COVID-19 in August 2020, the announcement by the Central Disaster and Safety Countermeasure Headquarters is being made regular every day. Sign language interpretation for the hearing impaired is broadcast on TV next to the speaker, but language communication for each individual for specific quarantine is insufficient. In this paper, AI construct motion recognition of sign language interpretation as Big Data, extract features of motion recognition data, and apply it to AI machine learning. Design an app to communicate with the hearing impaired on a smartphone owned by the hearing impaired. When a hearing impaired person writes TEXT or signs language on a smartphone, the smartphone recognizes it. Sign language motion is converted to text through motion recognition. The converted text is delivered to the general public as text to Speech through AI voice recognition. When an ordinary person speaks on a smartphone by voice, it is converted into text and displayed to the hearing impaired. This study will be used as a means of transmitting information to the hearing impaired in the Untact era. Develop a method for speech-impaired persons with disabilities to communicate with ordinary people who have not mastered sign language, using 4th industrial technology.