Archives

Kalinangan Refereed Journal

Volume no. 27 | 2019/11
Issue no. 2


Title
AIDING SYSTEM FOR HEARING-IMPAIRED PERSON BASED ON HAND GESTURES
Author
Cudiamat, Mark Justine R.; Panaligan, Trixie Marielle Paolin C.; Ruiz, Rica Mae R.; Aranas, Paul Justine H.; Magpantay, Anne Clarise T.; Landicho, Nicole T.; Publico,Michelle A.; Dimaano, Marijoy C.; Magtibay, Denver G. , RECE
Views: 706 Cited: 0
Downloads: 4
Click here to download
Abstract
Sign language is a way of communication with the deaf or hearing impaired people using hand gestures and other modalities. Since not all normal-speaking people are willing to study sign language, the researchers came up with the idea of an electronic system that can convert hand gestures to text/sound and can be electronically sent to achieve a successful two-way communication. The researchers developed and tested flex sensor embedded gloves using MPU6050 and Arduino processors which were programmed to convert hand signs to text. Furthermore, an android application was developed to train the gesture, as well as send and receive message, thus making conversation between the hearing impaired and the unimpaired possible. The system was subjected through a series of tests and trainings and attained an accuracy of 0.9917 and MCC value of 0.8475. A number of hearing-impaired respondents, employees from OPDA, CSWD, and a PECE evaluated the system giving it the accuracy rating of 88.33%.
Keywords
aiding system, Arduino processors, electronic gloves, electronic system, flex sensors, sign language
References
Ali, A., Mushstaq, A., Memon, A., & Monna, E. (2016). Hand gesture interpretation using sensing glove integrated with machine learning algorithms. World Academy of Science, Engineering and Technology International Journal of Mechanical and Mechatronics Engineering, 10 (11): 1857-1861.

Bukhari, J., Rehman, M., Malik, S., Kamboh, A., & Salman, A. (2015). American sign language translation through sensory glove. International Journal of u- and e- Service, Science and Technology, 8 (1): 131-139.

Chicco, C. (2017). Ten quick tips for machine learning in computational Biology. BioData Mining, 10(35).

Dong, C. (2015). American sign language alphabet recognition using Microsoft Kinect. 7392 Retrieved from http://bit.ly/2mNS8ai, September 2018.

Fok, K., Chen, C., Ganganat, N., & Chen, C. (2015). A real-time asl recognition system using leap motion sensor. (Conference Paper). International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery. Xi'an, China. Retrieved from http://bit.ly/2mSzrCu, September 2018.

Ibe, O. C. (2009). Markov processes for stochastic modeling. Academic Press, Amsterdam, Boston, MA. Retrieved from http://bit.ly/2nGvv8b, August 2018.

Kadry, R. & Birry, A. (2017). ASL recognition using leap motion and hand tracking mechanism. International Journal of Advances in Electronics and Computer Science,4 (9): 97-102.

Khan, T. (2015). Hand Gesture Recognition based on digital image processing using MATLAB. International Journal of Scientific & Engineering Research, 6 (9): 338-345.

Lim, I., Lu,J., Ng, C., Ong, T., & Ong, C. (2015). Sign-language recognition through gesture & movement analysis (SIGMA). Proceedings of the 2018 DLSU Research Congress, 3: 1-7.

Padden C. & Humphries, T. (1988). Deaf in America: Voices from a Culture. Cambridge, Mass.: Harvard University Press, 1988.

Salkind, N. (Ed.) (2010). Encyclopaedia of Research Design, Sage Publications, Canada. Retrieved from http://bit.ly/2opuW2z, August 2018.

Sornalatha, M. & Padmanabhan, V. (2014). Hand gesture recognition and voice conversion system for dumb people. International Journal of Scientific & Engineering Research, 5 (5).