Evaluation of Misclassification Matrix Method in Validation of an Assistive Device for Manual Wheelchair Propulsion

Evaluation of Misclassification Matrix Method in Validation of an Assistive Device for Manual Wheelchair Propulsion

  IJETT-book-cover           
  
© 2022 by IJETT Journal
Volume-70 Issue-12
Year of Publication : 2022
Author : M. H. Muhammad Sidik, S. A. Che Ghani, Abdul Nasir, M.N.F. Saniman
DOI : 10.14445/22315381/IJETT-V70I12P225

How to Cite?

M. H. Muhammad Sidik, S. A. Che Ghani, Abdul Nasir, M.N.F. Saniman, "Evaluation of Misclassification Matrix Method in Validation of an Assistive Device for Manual Wheelchair Propulsion," International Journal of Engineering Trends and Technology, vol. 70, no. 12, pp. 272-280, 2022. Crossref, https://doi.org/10.14445/22315381/IJETT-V70I12P225

Abstract
Classification accuracy is essential in the bio signal’s performance-based assistive devices. In this study, surface electromyography (SEMG) signals acquisition was extracted from 3 healthy right-handed participants. SEMG signal was processed, and Motor Unit Action Potential (MUAP) was determined. Accuracy, precision, sensitivity and specificity were calculated in real-time based on individual MUAP, critically compared with pattern and non-pattern recognition control methods by Misclassification Matrix inserted into Arduino MEGA 2560 Microcontroller. The results indicated that the performance of each control method is different for every participant and a comparison tool is a must to select the best out of it. It shows that the misclassification matrix filtered the best control method for participant 1 as Probability Density Function, no for participant 2 and Maximum Point Different (MPD) for participant 3 based on determined conditions.

Keywords
Arduino, Misclassification matrix, MUAP, Surface electromyography, Wheelchair propulsion.

References
[1] Salzberg, S. L, “On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach,” Data Mining and Knowledge Discovery, vol. 1, pp. 317–328, 1997. Crossref, https://doi.org/10.1023/a:1009752403260
[2] Peter M. Vitousek et al., “Human Domination of Earth’s Ecosystems,” Science, vol. 1979, no. 277, pp. 494–499, 1997.
[3] Foody, G. M, “Status of Land Cover Classification Accuracy Assessment,” Remote Sensing of Environment, vol. 80, no. 1, pp. 185–201, 2002. Crossref, https://doi.org/10.1016/S0034-4257(01)00295-4
[4] W. Kleynhans et al., “Ship Detection in South African Oceans Using a Combination of SAR and Historic LRIT Data,” 2013 IEEE International Geoscience and Remote Sensing Symposium-IGARSS, pp. 1521–1524, 2013. Crossref, https://doi.org/10.1109/IGARSS.2013.6723076
[5] Yaodan Xu et al., “Influence of Electrode Configuration on Muscle-Fiber-Conduction-Velocity Estimation Using Surface Electromyography,” IEEE Transactions on Biomedical Engineering, vol. 69, no. 8, pp. 2414-2422, 2022.
[6] Wawrzyniak, Z. M et al., “Objective EMG Signal Models Comparison for Gait Diagnostics,” Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments, vol. 11176, pp. 821–829, 2019.
[7] Narayan Y, “SEMG Signal Classification Using KNN Classifier with FD and TFD Features,” Materials Today Proceedings, vol. 37, no. 2, pp. 3219–3225, 2021. Crossref, https://doi.org/10.1016/j.matpr.2020.09.089
[8] Yogendra Narayan et al., “Elbow Movement Classification of a Robotic Arm Using Wavelet Packet and Cubic SVM,” Communication and Computing Systems, vol. 605–610, 2017. Crossref, http://dx.doi.org/10.1201/9781315364094-108
[9] Kumari, P et al., “Advance Approach Towards Elbow Movement Classification Using Discrete Wavelet Transform and Quadratic Support Vector Machine,” Communication and Computing Systems, pp. 839–844, 2017. Crossref, http://dx.doi.org/10.1201/9781315364094-151
[10] Phinyomark, A., Larracy, R., and Scheme, E, “Fractal Analysis of Human Gait Variability via Stride Interval Time Series,” Front Physiology, vol. 11, pp. 333, 2020. Crossref, https://doi.org/10.3389/fphys.2020.00333
[11] Sidik, M. M, Ghani, S. C, and Padzi, M. M, “Development of a Wireless Surface Electromyography (SEMG) Signal Acquisition Device for Power-Assisted Wheelchair System,” International Journal of Engineering and Advanced Technology, vol. 8, pp. 3414– 3418, 2019. Crossref, https://doi.org/ 10.35940/ijeat.F9511.088619
[12] M. H. Muhammad Sidik et al., “Innovation on Manual Wheelchair for Hemiplegic and Tetraplegic Patients,” International Journal of Engineering and Advanced Technology, vol. 8, pp. 3419–3425, 2019.
[13] M. H. Muhammad Sidik, S. A. Che Ghani, and M. N. F. Saniman, “A Real-Time EMG Pattern Recognition Control Method for Activation of Instrumented Wheelchair Power Assist System,” Palarch’s Journal of Archaeology of Egypt/Egyptology, vol. 17, no. 9, pp. 3430–3441, 2020.
[14] Chikh, S et al., “Arm-Trunk Coordination in Wheelchair Initiation Displacement: A Study of Anticipatory and Compensatory Postural Adjustments during Different Speeds and Directions of Propulsion,” Journal of Electromyography and Kinesiology, vol. 40, pp. 16–22, 2018. Crossref, https://doi.org/10.1016/j.jelekin.2018.03.001
[15] Jingwei Too et al., “Feature Selection Based on Binary Tree Growth Algorithm for the Classification of Myoelectric Signals,” Machines, vol. 6, no. 4, pp. 65, 2018.
[16] Bass A et al., “Comparison of the 6-Min Propulsion and Arm Crank Ergometer Tests to Assess Aerobic Fitness in Manual Wheelchair Users with a Spinal Cord Injury,” American Journal of Physical Medicine and Rehabilitation, vol. 99, pp. 1099–1108, 2020. Crossref, https://doi.org/10.3390/machines6040065
[17] Sindall, P. et al., “Practice Improves Court Mobility and Self-Efficacy in Tennis-Specific Wheelchair Propulsion,” Disability and Rehabilitation: Assistive Technology, vol. 16, no. 4, pp. 398–406, 2021. Crossref, https://doi.org/10.1080/17483107.2020.1761892
[18] Riemer J K Vegter et al., “Initial Skill Acquisition of Handrim Wheelchair Propulsion: A New Perspective,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 22, pp. 104–113, 2013. Crossref, https://doi.org/10.1109/tnsre.2013.2280301
[19] Sapienza, S et al., “On-Line Event-Driven Hand Gesture Recognition Based on Surface Electromyographic Signals,” 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-5, 2018.
[20] Jingwei Too et al., “Exploring the Relation Between EMG Pattern Recognition and Sampling Rate Using Spectrogram,” Journal of Electrical Engineering and Technology, vol. 14, pp. 947–953, 2019. Crossref, https://doi.org/10.1007/s42835-019-00083-3
[21] Xinyu Jiang et al., “Enhancing IoT Security via Cancelable HD-Semg-Based Biometric Authentication Password, Encoded By Gesture,” IEEE Internet of Things Journal, vol. 8, no. 22, pp. 16535–16547, 2021. Crossref, https://doi.org/10.1109/JIOT.2021.3074952
[22] Too, J et al., “Exploring the Relation Between EMG Pattern Recognition and Sampling Rate Using Spectrogram,” Journal of Electrical Engineering and Technology, vol. 14, pp. 947–953, 2019. Crossref, https://doi.org/10.1007/s42835-019-00083-3
[23] Ruuska, S. et al., “Evaluation of the Confusion Matrix Method in the Validation of an Automated System for Measuring Feeding Behaviour of Cattle,” Behavioural Processes, vol. 148, pp. 56–62, 2018. Crossref, https://doi.org/10.1016/j.beproc.2018.01.004
[24] Arruda, L. M. et al., ”Design and Testing of a Textile EMG Sensor for Prosthetic Control,” EAI International Conference on IoT Technologies for Healthcare, pp. 37–51, 2019.
[25] Gupta, P et al., “Accelerometer-Based Hand Gesture Controlled Wheelchair,” Imperial Journal of Interdisciplinary Research, vol. 2, no. 11, 2016.
[26] Ishii, C., and Konishi, R, “A Control of Electric Wheelchair Using an EMG Based on Degree of Muscular Activity,” 2016 Euromicro Conference, 2016. Crossref, https://doi.org/10.1109/DSD.2016.19
[27] Vikram Kehri et al., “A Machine Learning Approach for FEMG Pattern Recognition System to Control Hands-Free Wheelchair,” Proceedings of TRIBOINDIA-2018 an International Conference on Tribology, 2018. Crossref, https://dx.doi.org/10.2139/ssrn.3347101
[28] Marley Xiong et al., “A Low-Cost, Semi-Autonomous Wheelchair Controlled by Motor Imagery and Jaw Muscle Activation,” 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), 2019. Crossref, https://doi.org/10.1109/SMC.2019.8914544
[29] Rusydi, M. et al., “Robot Mobile Control Based on Three EMG Signals Using an Artificial Neural Network,” Materials Science and Engineering, vol. 602, no. 1, 2019. Crossref, https://doi.org/10.1088/1757-899X/602/1/012028
[30] Rami N.Khushaba et al., “Toward Improved Control of Prosthetic Fingers Using Surface Electromyogram (EMG) Signals,” Expert Systems with Applications, vol. 39, no. 12, pp. 10731–10738, 2012. Crossref, https://doi.org/10.1016/j.eswa.2012.02.192
[31] Giho Jang et al., “EMG-Based Continuous Control Scheme with Simple Classifier for Electric-Powered Wheelchair,” IEEE Transactions on Industrial Electronics, vol. 63, no. 6, pp. 3695-3705, 2016. Crossref, https://doi.org/10.1109/TIE.2016.2522385
[32] Ananda Sankar Kundu et al., “Hand Gesture Recognition-Based Omnidirectional Wheelchair Control Using IMU and EMG Sensors,” Journal of Intelligent and Robotic Systems, vol. 91, no. (3-4), pp. 529-541, 2018. Crossref, https://doi.org/10.1007/s10846-017-0725-0
[33] Anyuan Zhang et al., “Combined Influence of Classifiers, Window Lengths and Number of Channels on EMG Pattern Recognition for Upper Limb Movement Classification,” 2018 11th International Congress on Image and Signal Processing, Biomedical Engineering and Informatics (CISP-BMEI), 2018. Crossref, https://doi.org/10.1109/CISP-BMEI.2018.8633114