Low-cost Driver Assistance System for drivers suffering from Dyslexia or Color-blindness using Machine Learning

Lowcost Driver Assistance System for drivers suffering from Dyslexia or Colorblindness using Machine Learning

© 2021 by IJETT Journal
Volume-69 Issue-12
Year of Publication : 2021
Authors : Shikher Srivastava, Ayush Nigam, Dr. Madiajagan Muthaiyan
DOI :  10.14445/22315381/IJETT-V69I12P207

How to Cite?

Shikher Srivastava, Ayush Nigam, Dr. Madiajagan Muthaiyan, "Lowcost Driver Assistance System for drivers suffering from Dyslexia or Colorblindness using Machine Learning," International Journal of Engineering Trends and Technology, vol. 69, no. 12, pp. 47-55, 2021. Crossref, https://doi.org/10.14445/22315381/IJETT-V69I12P207

This paper proposes a Driver Assistance System with the capability of Traffic Sign and Traffic Light Detection from complex background images in a real-time environment with high efficiency. The proposed methodology aims to design an intelligent and self-sufficient model to extract the traffic sign and traffic light from a complex natural image using a camera with the help of Image Processing and Machine Learning. To make the traffic sign recognition perform efficiently in a real-time environment, a Machine Learning Model is trained with actual traffic sign data, i.e., images of real-life traffic signs. Traffic Lights are detected using color and shape differentiation techniques to extract a traffic post from the background and then extract the light from the post. This model can easily be installed in any vehicle with a mounted camera on the front or be a part of a more sophisticated vehicle controlling system. It will recognize traffic lights and road signs and then accordingly instruct the required actions to the driving agent, especially helpful for drivers suffering from color-blindness or dyslexia.

Driver Assistance System, Iterative End-Point Fit Algorithm, Traffic Sign Recognition, Traffic Light Recognition, Support Vector Machine (SVM)

[1] Regan, Michael A., Charlene Hallett, and Craig P. Gordon., Driver distraction and driver inattention: Definition, relationship, and taxonomy. Accident Analysis & Prevention, 43(5) (2011) 1771-1781.
[2] R.R. Thoker, R. Gupta, E.N. Kumar, Study on congestion of national highways due to traffic volume, International Journal of Engineering Trends and Technology, 68 (2) (2020) 36–41.
[3] Y. Jie, A new traffic light detection and recognition algorithm for electronic travel aid., (2013) 644-648.
[4] G. Mu, Traffic light detection and recognition for autonomous vehicles., The Journal of China Universities of Posts and Telecommunications, 22 (1) (2015) 50-56.
[5] Y. K. Kim, K. W. Kim, X. Yang, Real-time traffic light recognition system for color vision deficiencies, (2007) 76-81.
[6] Ranney, Thomas A., W. Riley Garrott, and Michael J. Goodman. NHTSA driver distraction research: Past, present, and future. No. 2001-06-0177. SAE Technical Paper, (2001).
[7] A. Thierer, R. Hagemann, Removing roadblocks to intelligent vehicles and driverless cars., Wake Forest JL &Pol`y, 5 (2015) 339.
[8] Ascone, Debra, Tonja Tonja Lindsey, and Cherian Varghese. An examination of driver distraction as recorded in NHTSA databases. No. DOT HS 811 216. The United States. National Highway Traffic Safety Administration, (2009).
[9] Angell, Linda, Miguel Perez, and W. Riley Garrott. Explanatory Material About the Definition of a Task Used in NHTSA`s Driver Distraction Guidelines and Task Examples. No. DOT HS 811 858. (2013).
[10] Tejero, Pilar, Beatriz Insa, and Javier Roca, Difficulties of drivers with dyslexia when reading traffic signs: analysis of reading, eye gazes, and driving performance, Journal of learning disabilities, 52(1) (2019) 84-95.
[11] Olivera, I. P., et al. A Vision of Traffic Lights for Color-Blind People, The Fourth International Conference on Smart Systems, Devices and Technologies (SMART), Brazil., (2015) 34-36.
[12] M. Sharifi, M. Fathy, M. T. Mahmoudi, A classified and comparative study of edge detection algorithms, Proceedings. International conference on information technology: coding and computing, IEEE, (2002) 117-120.
[13] O. R. Vincent, O. Folorunso, A descriptive algorithm for sobel image edge detection., Vol. 40, Informing Science Institute, California,(2009) 97-107.
[14] Bhardwaj, Saket, and Ajay Mittal., A survey on various edge detector techniques., Procedia Technology, 4 (2012) 220-226.
[15] Liqin, Shen, Shen Dinggang, and Qi Feihu., Edge detection on real-time using LOG filter, Proceedings of ICSIPNN`94. International Conference on Speech, Image Processing, and Neural Networks. IEEE, (1994) 37-40.
[16] Kumar, Sunil, Amit Kumar Upadhyay, Preeti Dubey, and Sudeep Varshney, Comparative analysis for Edge Detection Techniques, In 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), IEEE, (2021) 675-681.
[17] Mohd Ali, Nursabillilah, NahrulKhairAlang Md Rashid, and Yasir MohdMustafah, Performance comparison between RGB and HSV color segmentations for road signs detection, Applied Mechanics and Materials., Trans Tech Publications Ltd, 393 (2013) 550-555.
[18] S. Vitabile, Road signs recognition using a dynamic pixel aggregation technique in the HSV color space., IEEE, (2001) 572-577.
[19] Nevatia, Ramakant, and K. Ramesh Babu., Linear feature extraction and description, Computer Graphics and Image Processing, 13(3) (1980) 257-269.
[20] Saalfeld, Alan., Topologically consistent line simplification with the Douglas-Peucker algorithm., Cartography and Geographic Information Science, 26(1) (1999) 7-18.
[21] Salhi, Abderrahim, BrahimMinaoui, and Mohamed Fakir. "Robust Automatic Traffic Signs Detection using a fast polygonal approximation of digital curves, 2014 International Conference on Multimedia Computing and Systems (ICMCS). IEEE, (2014) 433-437
[22] Omachi, Masako, and Shinichiro Omachi., Traffic light detection with color and edge information. 2009 2nd IEEE International Conference on Computer Science and Information Technology. IEEE, (2009).
[23] Chapelle, Olivier, Patrick Haffner, and Vladimir N. Vapnik., Support vector machines for histogram-based image classification, IEEE transactions on Neural Networks, 10(5) (1999) 1055-1064.
[24] Suleiman, Amr, and Vivienne Sze., Energy-efficient HOG-based object detection at 1080HD 60 fps with multi-scale support. 2014 IEEE Workshop on Signal Processing Systems (SiPS). IEEE, (2014).
[25] Tzotsos, Angelos, and DemetreArgialas., Support vector machine classification for object-based image analysis, Object-Based Image Analysis. Springer, Berlin, Heidelberg, (2008) 663-677.
[26] Chapelle, Olivier, Patrick Haffner, and Vladimir N. Vapnik., Support vector machines for histogram-based image classification, IEEE transactions on Neural Networks, 10(5) (1999) 1055-1064.