Submit your paper : editorIJETjournal@gmail.com

Paper Title : Sign Language and Emotion Recognition Using Convolution Neural Networks

ISSN : 2395-1303
Year of Publication : 2022
10.5281/zenodo.7334381

Authors: Mohammed Imran SK, Thota Ashmitha Reddy, Mandala Koushitha reddy, Kondam Sanjana Reddy

         


Abstract
In this study, a real-time sign and emotion identification system is developed utilising a deep learning toolkit for sign language and a traditional neural network for emotion recognition.We aim to combine a manual sign language recognition system with an emotion recognition system that can recognise both emotions and gestures in real time because sign language is not an international language and cannot be used as a medium of communication between an impaired person and a normal person.

Reference
[1]. Mehreen Hurroo , Mohammad Elham, 2020, Sign Language Recognition System using Convolutional Neural Network and Computer Vision, INTERNATIONAL JOURNAL OF ENGINEERING RESEARCH & TECHNOLOGY (IJERT) Volume 09, Issue 12 (December 2020), [2]. Ahmed KASAPBAŞI, Ahmed Eltayeb AHMED ELBUSHRA, Omar AL-HARDANEE, Arif YILMAZ, DeepASLR: A CNN based human computer interface for American Sign Language recognition for hearing-impaired individuals,Computer Methods and Programs in Biomedicine Update,Volume 2,2022, [3].International Conference on Trendz in Information Sciences and Computing (TISC). : 30-35, 2012. [4]. Herath, H.C.M. & W.A.L.V.Kumari, & Senevirathne, W.A.P.B & Dissanayake, Maheshi. (2013). IMAGE BASED SIGN LANGUAGE RECOGNITION SYSTEM FOR SINHALA SIGN LANGUAGE [5]. Huang, J., Zhou, W., & Li, H. (2015). Sign Language Recognition using 3D convolutional neural networks. IEEE International Conference on Multimedia and Expo (ICME) (pp. 1-6). Turin: IEEE. [6]. Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011). HMDB: a large video database for human motion recognition. Computer Vision (ICCV), 2011 IEEE International Conference on (pp. 2556-2563). IEEE [7]. M. Geetha and U. C. Manjusha, , A Vision Based Recognition of Indian Sign Language Alphabets and Numerals Using B-Spline Approximation, Inter- national Journal on Computer Science and Engineering (IJCSE), vol. 4, no. 3, pp. 406-415. 2012. [8]. Raut, Nitisha, "Facial Emotion Recognition Using Machine Learning" (2018). Master's Projects.632.DOI:https://doi.org/10.31979/etd.w5fs-s8wdhttps://scholarworks.sjsu.edu/etd_projects/632 [9]. H. Ebine, Y. Shiga, M. Ikeda and O. Nakamura, "The recognition of facial expressions with automatic detection of the reference face," 2000 Canadian Conference on Electrical and Computer Engineering. Conference Proceedings. Navigating to a New Era (Cat. No.00TH8492), Halifax, NS, 2000, pp. 1091-1099 vol.2. [10].K. M. Rajesh and M. Naveenkumar, "A robust method for face recognition and face emotion detection system using support vector machines," 2016 International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT), Mysuru, 2016 [11]. X. Jiang, "A facial expression recognition model based on HMM," Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology, Harbin, Heilongjiang, China, 2011
Keywords
— CNN, facial expressions, emotions, gestures, sign language, and open cv