Open Access Open Access  Restricted Access Subscription or Fee Access

Conversion of American Sign Language into Text using Deep Learning

A. K. Srilakshmi, N. Yashaswini, Anitha Suresh

Abstract


The Sign language is one of the easy ways of communication to dumb and deaf people. Not all people can understand sign language; the requirement of sign language translator is high. This paper focuses on detecting sign language using deep learning concepts, which acts as a translator. The aim of this project is to convert sign language of static type into its corresponding text. This is done using 2 main steps, data creation and training and deploying the model. The process include real time input which is then converted into threshold image, later these images are trained using CNN model and finally feature classification is done. Then we obtain Static ASL output.

Keywords


Sign Language, Tensorflow, Keras, Numpy, OpenCV, Deep Learning.

Full Text:

PDF

References


Ankita Wadhawan, Parteek Kumar” Deep learning-based sign language recognition system for static signs”, Springer-Verlag London Ltd., part of Springer Nature 2020, Neural Computing and Applications, https://doi.org/10.1007/s00521-019-04691- y.

Jain,V.,Jain,A.,Chauhan,A.etal.American Sign Language recognition using Support Vector Machine and Convolutional Neural Network Int.j.inf.tecnol.(2021).https://doi.org/10.1007/s41870- 021-00617-x.

K. Tiku, J. Maloo, A. Ramesh and I. R, "Real-time Conversion of Sign Language to Text and Speech", 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India, 2020, pp. 346-351, DOI:10.1109/ICIRCA48905.2020.9182877.

Lean karlo S. Tolentino, Ronnie O. Serfa Juan, August C. Thio-ac, Maria Abigail B. Pamahoy, Joni Rose R. Forteza, and Xavier jet O. Garcia, “Static Sign language Recognition using Deep learning”, International journal of Machine learning and computing, Vol. 9, No.6, December2019.

Mahesh Kumar, Assistant Professor (Senior Grade), Bannari Amman Institute of Technology, Sathyamangalam, Erode, India. “Conversion of Sign Language into Text”, International Journal of Applied Engineering Research, Volume 13,2018

S. Rajaganapathy, B. Aravind, B. Keerthana, M. Sivagami, “Conversation of Sign Language to Speech with Human Gestures”, Procedia Computer Science, Volume 50,2015.

P. Vijayalakshmi and M. Aarthi, "Sign language to speech conversion," 2016 International Conference on RecentTrends in Information Technology (ICRTIT), Chennai, 2016, pp. 1-6, doi: 10.1109/ICRTIT.2016.7569545.

A. Kumar, K. Thankachan and M. M. Dominic, "Sign language recognition," 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, 2016, pp. 422-428, doi: 10.1109/RAIT.2016.7507939.

K. S. Warrier, J. K. Sahu, H. Halder, R. Koradiya and V. K. Raj, "Software based sign language converter," 2016 International Conference on Communication and Signal Processing (ICCSP), Melmaruvathur, 2016, pp. 1777-1780, doi:10.1109/ICCSP.2016.7754472.

TY - JOUR,AU - Arsan, Taner,AU - Ulgen, Oguz,PY - 2015/08/31,SP - 39,EP - 51,T1 - Sign Language Converter,VL - 6,DO - 10.5121/ijcses.2015.6403,JO - International Journal of Computer Science & Engineering Survey

R. R. Itkarkar and A. V. Nandi, "Hand gesture to speech conversion using Matlab," 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT), Tiruchengode, 2013, pp. 1-4, doi: 10.1109/ICCCNT.2013.6726505.

K. A. Bhaskaran, A. G. Nair, K. D. Ram, K. Ananthanarayanan and H. R. Nandi Vardhan, "Smart gloves for hand gesture recognition: Sign language to speech conversion system," 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), Kollam, 2016, pp. 1-6, doi: 10.1109/RAHA.2016.7931887.


Refbacks

  • There are currently no refbacks.