Open Access Open Access  Restricted Access Subscription or Fee Access

A Methodology for Sign Language Video Analysis and Translation into Text in Hindi Language

Rashmi B Hiremath, Ramesh M Kagalkar

Abstract


Sign language based communication is basically essential by consistently changing distinctive hand shapes and development by a signer. The proposed framework going to recognize the sign of gesture-based communication from a video stream of the signer and deciphers into relating words and sentences in Hindi. The proposed framework utilizes the image preparing strategies and synthetic intelligence procedures to get the target. To do the proposed task execution it utilizes picture handling strategies, for example, frame differencing based tracking, edge recognition, wavelet change, picture combination systems to area shapes in our videos. It moreover utilizes descriptors of elliptical Fourier for feature extraction of shape and also uses analysis for the purpose of feature set reduction as well as optimization. Extracted features are stored into the database and compared with given input video of the signer by a trained unclear inference system


Keywords


Sign Language, Image Processing, Gesture Recognition, Video Processing.

Full Text:

PDF

References


M. Rizwan Abid, E. M. Petriu and E. Amjadian, “Dynamic Sign Language Recognition for Smart Home Interactive Application Using Stochastic Linear Formal Grammar”, IEEE Transactions On Instrumentation And Measurement, vol 64, no. 3, Mar 2015

P.V.V.Kishore, P.Rajesh Kumar, E.Kiran Kumar, and S.R.C.Kishore, “Video Audio Interface for Recognizing Gestures of Indian Sign Language”, International Journal of Image Processing (IJIP), Volume (5) ,Issue (4), 2011.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Automatic Graph Based Clustering for Image Searching and Retrieval from Database”, CiiT Software Engineering and Technology, Vol 8, No 2, 2016.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Review Paper: Detail Study for Sign Language Recognition Techniques”, CiiT Digital Image Processing, Vol 8, No 3, 2016..

Ramesh Kagalkar and Dr. Nagaraja H.N “New Methodology for Translation of Static Sign Symbol to Words in Kannada Language”,” International Journal of Computer Applications Volume 121, Page No 26-30,July-2015

A. Chaudhary, J. L. Raheja, K. Das, and S. Raheja, “A survey on hand gesture recognition in context of soft computing,” in Proc. CCSIT, vol. 133. Jan. 2011, pp. 46–55.

A. El-Sawah, N. D. Georganas, and E. M. Petriu, “A prototype for 3-D hand tracking and posture estimation,” IEEE Trans. Instrum. Meas., vol. 57, no. 8, pp. 1627–1636, Aug. 2008.

Ramesh M. Kagalkar, Dr. Nagaraj H.N and Dr. S.V Gumaste, ”A Novel Technical Approach for Implementing Static Hand Gesture Recognition”, International Journal of Advanced Research in Computer and Communication Engineering ISSN (Online) 2278-1021 ISSN (Print) 2319-5940 Vol. 4, Issue 7, July 2015.

A. R. Varkonyi-Koczy and B. Tusor, “Human–computer interaction for smart environment applications using fuzzy hand posture and gesture models,” IEEE Trans. Instrum. Meas., vol. 60, no. 5, pp. 1505–1514, May 2011.

C.-C. Chang and C.-J. Lin, “LIBSVM: A library for support vector machines,” ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 1–27, 2011.

M. R. Abid, L. B. S. Melo, and E. M. Petriu, “Dynamic sign language and voice recognition for smart home interactive application,” in Proc. IEEE Int. Symp. Med. Meas. Appl. (MeMeA), May 2013, pp. 139–144.

S. Shiravandi, M. Rahmati, and F. Mahmoudi, “Hand gestures recognition using dynamic Bayesian networks,” in Proc. 3rd Joint Conf. AI Robot. 5th RoboCup Iran Open Int. Symp. (RIOS), Apr. 2013, pp. 1–6.

T. Wenjun, W. Chengdong, Z. Shuying, and J. Li, “Dynamic hand gesture recognition using motion trajectories and key frames,” in Proc. 2nd Int. Conf. Adv. Comput. Control (ICACC), Mar. 2010, pp. 163–167.

J. Bao, A. Song, Y. Guo, and H. Tang, “Dynamic hand gesture recognition based on SURF tracking,” in Proc. Int. Conf. Elect. Inf. Control Eng. (ICEICE), Apr. 2011, pp. 338–341.

Z. Yang, Y. Li, W. Chen, and Y. Zheng, “Dynamic hand gesture recognition using hidden Markov models,” in Proc. 7th Int. Conf. Comput. Sci. Edu. (ICCSE), Jul. 2012, pp. 360–365.

P. K. Pisharady and M. Saerbeck, “Robust gesture detection and recognition using dynamic time warping and multi-class probability estimates,” in Proc. IEEE Symp. Comput. Intell. Multimedia, Signal Vis. Process. (CIMSIVP), Apr. 2013, pp. 30–36.

Ramesh Kagalkar and Dr. Nagaraja H.N “New Methodology for Translation of Static Sign Symbol to Words in Kannada Language”,” International Journal of Computer Applications Volume 121, Page No 26-30,July-2015

Ramesh M. Kagalkar, Dr. Nagaraj H.N and Dr. S.V Gumaste, ”A Novel Technical Approach for Implementing Static Hand Gesture Recognition”, International Journal of Advanced Research in Computer and Communication Engineering ISSN (Online) 2278-1021 ISSN (Print) 2319-5940 Vol. 4, Issue 7, July 2015.

Amit kumar and Ramesh Kagalkar “ Advanced Marathi Sign Language Recognition using Computer Vision” , International Journal of Computer Applications (0975 – 8887) Volume 118 – No. 13, May 2015.

Amit kumar and Ramesh Kagalkar “Sign Language Recognition for Deaf User”, Internal Journal for Research in Applied Science and Engineering Technology, Volume 2 Issue XII, December 2014.

Amit kumar and Ramesh Kagalkar “Methodology for Translation of Sign Language into Textual Version in Marathi”, CiiT, International Journal of Digital Image Processing, Volume 07, No.08 , Aug 2015.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Automatic Graph Based Clustering for Image Searching and Retrieval from Database”, CiiT Software Engineering and Technology, Vol 8, No 2, 2016.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Review Paper: Detail Study for Sign Language Recognition Techniques”, CiiT Digital Image Processing, Vol 8, No 3, 2016.

Swati Sargule, Ramesh M Kagalkar”Hindi Language Document Summarization using Context Based Indexing Model”, CiiT International Journal of Data Mining Knowledge Engineering, Vol.08 No. 01, Jan Issue 2016.

Ramesh M Kagalkar, Kajal Chavan, Asmita Jadhav , Ravina Patil and Asmita Rawool, ” Self-Educating Tool Kit for Kids” CiiT Software Engineering and Technology, Vol 8, No 1, 2016.

Vasundhara Kadam and Ramesh Kagalkar,“ Review on Textual Description of Image Contents”, International Journal of Computer Applications (0975 – 8887) National Conference on Advances in Computing (NCAC 2015)

Rachana Palaskar, Shweta Pandey, Ashwini Telang, Akshada Wagh, Ramesh Kagalkar,“ An Automatic Monitoring and Swing the Baby Cradle for Infant Care”, International Journal of Advanced Research in Computer and Communication Engineering,Vol. 4, Issue 12, December 2015.

Mrunmayee and Ramesh Kagalkar “A Review On Conversion Of Image To Text As Well As Speech Using Edge Detection And Image Segmentation” International Journal of Advance Research in Computer Science Management Studies, Volume 2, Issue 11 (November-2014) publish on 29th November to 30th November 2014.

Mrunmayee Patil and Ramesh Kagalkar “ An Automatic Approach for Translating Simple Images into Text Descriptions and Speech for Visually Impaired People” , International Journal of Computer Applications (0975 – 8887) Volume 118 – No. 3, May 2015.

Kaveri Kamble and Ramesh Kagalkar, “A Review: Translation of Text to Speech Conversion for Hindi Language ”, International Journal of Science and Research (IJSR) ISSN (Online): 2319-7064, Vol. 3 Issue 11, November 2014.

Kaveri Kamble and Ramesh Kagalkar, “Audio Visual Speech Synthesis and Speech Recognition for Hindi Language ” , International Journal of Computer Science and Information Technologies(IJCSIT) ISSN (Online): 0975-9646, Vol. 6 Issue 2, April 2015.

Kaveri Kamble and Ramesh Kagalkar “ A Novel Approach for Hindi Text Description to Speech and Expressive Speech Synthesis” International Journal of Applied Information Systems (IJAIS) – ISSN : 2249-0868 Foundation of Computer Science FCS, New York, USA Volume 8– No.7, May 2015.

Shivaji Chaudhari and Ramesh Kagalkar “A Review of Automatic Speaker recognition and Identifying Speaker Emotion Using Voice Signal” International Journal of Science and Research (IJSR), Volume 3, Issue 11 November 2014.

Shivaji Chaudhari and Ramesh Kagalkar “ Automatic Speaker Age Estimation and Gender Dependent Emotion Recognition”, International Journal of Computer Applications (0975 – 8887) Volume 117 – No. 17, May 2015.

Shivaji J. Chaudhari and Ramesh M Kagalkar, “A Methodology for Efficient Gender Dependent Speaker Age and Emotion Identification System”, International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE) ISSN 2319-5940, Volume 4, Issue 7, July 2015.

Ajay R. Kadam and Ramesh Kagalkar,“ Audio Scenarios Detection Technique”, International Journal of Computer Applications (IJCA),Volume 120 June 2015, Edition ISBN : 973-93-80887-55-4.

Ajay R. Kadam and Ramesh Kagalkar,“ A Review Paper on Predictive Sound Recognition System”, CiiT International Journal of Software Engineering and Technology, June Issue 2015 on 30/6/2015.

Ajay R. Kadam and Ramesh Kagalkar,“ Predictive Sound Recognition System ”, International Journal of Advance Research in Computer Science and Management Studies, Volume 2, Issue11 ISSN(Online):2321-7782.

Ramesh.M.Kagalkar and P.N.Girija ” Neural Network Based Document Image Analysis for Text, Image Localization Using Wavelet Decomposition and Mathematical Morphology” International Journal on Computer Science and Information Technology(IJCEIT) Volume 16, No 21, ISSN 0974-2034, Jan-Feb 2010.

Ramesh.M.Kagalkar, Mrityunjaya .V. Latte and Basavaraj.M.Kagalkar ”An Improvement In Stopping Force Level Set Based Image Segmentation” International Journal on Computer Science and Information Technology(IJCEIT) ISSN 0974-2034, Volume 24, Issue No 01, June – August 2010.

Ramesh.M.Kagalkar, Mrityunjaya.V.Latte and Basavaraj.M.Kagalkar ” Template Matching Method For Localization Of Suspicious Area And Classification Of Benign Or Malignant Tumors Area In Mammograms ” International Journal on Computer Science and Information Technology (IJCECA) ISSN 0974-2034, Volume 25, Issue No 01, Jan– March 2011.

Dr.M. Siddappa and Ramesh M. Kagalkar ”Methodologies for Tumor Detection Algorithm as Suspicious Region from Mammogram Images Using SVM Classifier Technique” CiiT International Journal Of Digital Image Processing, Vol 7, No 8 (2015), ISSN 0974-9691 and Online: ISSN 0974-9586, Jan-Feb 2012.

Ekta Naik and Ramesh Kagalkar “Double Guard: Detecting and Preventing Intrusions In Multi-tier Web Applications” International Journal of Scientific & Engineering Research, Volume 5, Issue 12, December-2014 127 ISSN 2229-5518.

Vrushali K Gaikwad and Ramesh Kagalkar “Security and Verification of Data in Multi-Cloud Storage with Provable Data Possession”, International Journal of Computer Applications (0975 – 8887) Volume 117 – No. 5, May 2015.

Vrushali K Gaikwad and Ramesh Kagalkar, “Data Security & Availability in Multi-Cloud Storage with Cooperative Provable Data Possession”, International Journal of Engineering and Computer Science, 2319-7242, Volume 4 Issue 2 February 2015, Page No. 10375-10379.

Ramesh Kagalkar and Dr. Nagaraja H.N “New Methodology for Translation of Static Sign Symbol to Words in Kannada Language”,” International Journal of Computer Applications Volume 121, Page No 26-30,July-2015

Ramesh M. Kagalkar, Dr. Nagaraj H.N and Dr. S.V Gumaste, ”A Novel Technical Approach for Implementing Static Hand Gesture Recognition”, International Journal of Advanced Research in Computer and Communication Engineering ISSN (Online) 2278-1021 ISSN (Print) 2319-5940 Vol. 4, Issue 7, July 2015.

Amit kumar and Ramesh Kagalkar “ Advanced Marathi Sign Language Recognition using Computer Vision” , International Journal of Computer Applications (0975 – 8887) Volume 118 – No. 13, May 2015.

Amit kumar and Ramesh Kagalkar “Sign Language Recognition for Deaf User”, Internal Journal for Research in Applied Science and Engineering Technology, Volume 2 Issue XII, December 2014.

Amit kumar and Ramesh Kagalkar “Methodology for Translation of Sign Language into Textual Version in Marathi”, CiiT, International Journal of Digital Image Processing, Volume 07, No.08 , Aug 2015.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Automatic Graph Based Clustering for Image Searching and Retrieval from Database”, CiiT Software Engineering and Technology, Vol 8, No 2, 2016.

Ramesh. M. Kagalkar and Dr. S. V. Gumaste “Review Paper: Detail Study for Sign Language Recognition Techniques”, CiiT Digital Image Processing, Vol 8, No 3, 2016.

Swati Sargule, Ramesh M Kagalkar”Hindi Language Document Summarization using Context Based Indexing Model”, CiiT International Journal of Data Mining Knowledge Engineering, Vol.08 No. 01, Jan Issue 2016.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.