Citation :

Kumara Maruthi M. Mullur, "Indian Sign Language Recognition System," International Journal of Engineering Trends and Technology (IJETT), vol. 21, no. 2, pp. 450-454, 2015. Crossref, https://doi.org/10.14445/22315381/IJETT-V21P288

Abstract

Indian Sign Language (ISL) is a language which, instead of acoustically conveyed sound patterns, uses gesture language to convey meaning, which was developed for those who are physically disabled to speak/hear. There are thousands of people who will speak through ISL. In this paper, an attempt is made for them to communicate with other people with the help of Computer Vision (CV) and Artificial Neural Networks (ANN). CV and ANN are the two fascinating and challenging fields in computer science stream. The gestures of ISL are recorded using a video camera; video camera captures the sequence of frames which contains the signs made by the physically disabled people. This image will be processed to get the significance of the sign which is converted into audio. This will aid the physically disabled people (dumb) to communicate without any pen and paper with other people around them who do not understand ISL.

Keywords

Indian Sign Language, Artificial Neural Networks, Computer Vision, Image Processing.

References

[1] Joyeeta Singha and Karen Das, “ Indian Sign Language Recognition Using Eigen Value Weighted Euclidean Distance Based Classification Technique,” (IJACSA) International Journal of Advanced Computer Science and Applications, Vol. 4, No. 2, 2013.
[2] R. Gopalan and B. Dariush, “Towards a Vision Based Hand Gesture Interface for Robotic Grasping”, The IEEE/RSJ International Conference on Intelligent Robots and Systems, October 11-15, 2009, St. Louis, USA, pp. 1452-1459.
[3] T. Kapuscinski and M. Wysocki, “Hand Gesture Recognition for Man-Machine interaction”, Second Workshop on Robot Motion and Control, October 18-20, 2001, pp. 91-96.
[4] D. Y. Huang, W. C. Hu, and S. H. Chang, “Vision-based Hand Gesture Recognition Using PCA+Gabor Filters and SVM”, IEEE Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2009, pp. 1-4.
[5] C. Yu, X. Wang, H. Huang, J. Shen, and K. Wu, “Vision-Based Hand Gesture Recognition Using Combinational Features”, IEEE Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2010, pp. 543-546.
[6] Dataglove model 2 operating manual. VPL Research Inc., 1989.
[7] V. C. Tartter and K. C. Knowlton. –“ Perception of sign language from an array of 27 moving spots‖ ”, Nature, pp (239,676,678), Feb. 19, 1981.
[8] R. Cipolla, Y. Okamoto, and Y. Kuno. – “Robust structure from motion using motion parallax”, In Proc. 4th Intl. Conf. Computer Vision.
[9] B. Dorner. – “Hand shape identi_cation and tracking for sign language interpretation‖ ”, In Looking at people workshop, Chambery, France, 1993. IJ-CAI.
[10] J. Triesch and C. von der Malsburg. – “A System for Person- Independent Hand Posture Recognition against Complex Background”, IEEE, 2001 Transactions on Pattern Analysis and Machine Intelligence, Vol.23, No. 12, December 2001.
[11] E. Sanchez Nielsen, L. Antón Canalis, M. Hernandez Tejera, -“Hand gesture recognition for human machine interaction‖ ”, Journal of WSCG, Vol.12, No.1-3 (February 2003).
[12] C. Chang, Y Chen, and Huang, "Hand Pose Recognition Using Curvature Scale Space", IEEE International Conference on Pattern Recognition, 2002.
[13] A. Utsumi, T. Miyasato and F. Kishino, "Multi-Camera Hand Pose Recognition System Using Skeleton Image", IEEE International Workshop on Robot and Human Communication, pp. 219-224, 1995.
[14] Aviad Barzilai, Adi Fuchs, Michael Kolomenkin, "Hand Gesture Classification Using Depth Information", CGM Laboratory undergraduate project, Electrical Engineering Dept., Technion – IIT, 2009
[15] R. Rosales, V. Athitsos, L. Sigal, and S. Sclaroff, "3D Hand Pose Reconstruction Using Specialized Mappings", IEEE International Con. on Computer Vision, pp. 378- 385, 2001.
[16] C. Tomasi, S. Petrov, and A. Sastry, "3D Classification + Interpolation", IEEE International Conf. on Computer Vision, 2003.
[17] W. T. Freeman and M. Roth, "Orientation Histograms for Hand Gesture Recognition", IEEE International Conf. on Automatic Face and Gesture Recognition, 1995.
[18] L. Bretzner, I. Laptev, and T. Lindberg, "Hand Gesture Recognition using Multi-Scale Color Features, Hierarchical Models and Particle Filtering", IEEE International Conf. on Automatic Face and Gesture Recognition, 2002.