Thought-Actuated Wheelchair Navigation with Communication Assistance Using Statistical Cross-Correlation-Based Features and Extreme Learning Machine
DOI: 10.4103/jmss.JMSS_52_19
Abstract
A simple data collection approach based on electroencephalogram (EEG) measurements has been proposed in this study to implement a brain-computer interface, i.e., thought-controlled wheelchair navigation system with communication assistance. The EEG signals are recorded for seven simple tasks using the designed data acquisition procedure. These seven tasks are conceivably used to control wheelchair movement and interact with others using any odd-ball paradigm. The proposed system records EEG signals from 10 individuals at eight-channel locations, during which the individual executes seven different mental tasks. The acquired brainwave patterns have been processed to eliminate noise, including artifacts and powerline noise, and are then partitioned into six different frequency bands. The proposed cross-correlation procedure then employs the segmented frequency bands from each channel to extract features. The cross-correlation procedure was used to obtain the coefficients in the frequency domain from consecutive frame samples. Then, the statistical measures (“minimum,” “mean,” “maximum,” and “standard deviation”) were derived from the cross-correlated signals. Finally, the extracted feature sets were validated through online sequential-extreme learning machine algorithm. The results of the classification networks were compared with each set of features, and the results indicated that M (r) feature set based on cross-correlation signals had the best performance with a recognition rate of 91.93%.
Keywords
Full Text:
PDFReferences
Lacomis D, Petrella JT, Giuliani MJ. Causes of neuromuscular weakness in the intensive care unit: A study of ninety-two patients. Muscle Nerve 1998;21:610-7.
Lees AJ, Blackburn NA, Campbell VL. The nighttime problems of Parkinson's disease. Clin Neuropharmacol 1988;11:512-9.
Chávez DL, Cruz JR, Avilés C. Mouse Pointer Controlled by Ocular Movements. In Proceedings of the 7th WSEAS International Conference on Computational Intelligence, Man-Machine Systems and Cybernetics. World Scientific and Engineering Academy and Society; 2008. p. 11-8.
Pfurtscheller G, Muller-Putz GR, Scherer R, Neuper C. Rehabilitation with brain-computer interface systems. Computer 2008;41:58-65.
Birbaumer N, Cohen LG. Brain-computer interfaces: Communication and restoration of movement in paralysis. J Physiol 2007;579:621-36.
Mohammadi Z, Frounchi J, Amiri M. Wavelet-based emotion recognition system using EEG signal. Neural Comput Appl 2017;28:1985-90.
Barua S, Ahmed MU, Ahlström C, Begum S. Automatic driver sleepiness detection using EEG EOG and contextual information. Expert Syst Appl 2019;115:121-35.
Fazli S, Mehnert J, Steinbrink J, Curio G, Villringer A, Müller KR, et al. Enhanced performance by a hybrid NIRS-EEG brain computer interface. Neuroimage 2012;59:519-29.
Grierson LE, Zelek J, Lam I, Black SE, Carnahan H. Application of a tactile way-finding device to facilitate navigation in persons with dementia. Assist Technol 2011;23:108-15.
Kaufmann T, Herweg A, Kübler A. Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials. J Neuroeng Rehabil 2014;11:7.
Lazarou I, Nikolopoulos S, Petrantonakis PC, Kompatsiaris I, Tsolaki M. EEG-Based Brain-Computer Interfaces for Communication and Rehabilitation of People with Motor Impairment: A novel approach of the 21st Century. Front Hum Neurosci 2018;12:14.
Liu D, Liu C, Hong B. Bi-directional Visual Motion Based BCI Speller. In 2019 9th International IEEE/EMBS Conference on Neural Engineering; 2019. p. 589-92.
Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B. A review of classification algorithms for EEG-based brain-computer interfaces: J Neural Eng 2007;4. p. 1.
McFarland DJ, Miner LA, Vaughan TM, Wolpaw JR. Mu and beta rhythm topographies during motor imagery and actual movements. Brain Topogr 2000;12:177-86.
Moghimi S, Kushki A, Guerguerian AM, Chau T. A review of EEG-based brain-computer interfaces as access pathways for individuals with severe disabilities. Assist Technol 2013;25:99-110.
Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clin Neurophysiol 2002;113:767-91.
Suppes P, Lu ZL, Han B. Brain wave recognition of words. Proc Natl Acad Sci U S A 1997;94:14965-9.
Birbaumer N, Kübler A, Ghanayim N, Hinterberger T, Perelmouter J, Kaiser J, et al. The thought translation device (TTD) for completely paralyzed patients. IEEE Trans Rehabil Eng 2000;8:190-3.
Porbadnigk A, Wester M, Calliess J, Schultz T. EEG-based speech recognition impact of temporal effects. 2nd International Conference on Bio-Inspired Systems and Signal Processing (BIOSIGNALS); 2009.
Guenther FH, Brumberg JS. Brain-machine interfaces for real-time speech synthesis. Conf Proc IEEE Eng Med Biol Soc 2011;2011:5360-3.
Salama M, Elsherif L, Lashin H, Gamal T. Recognition of Unspoken Words Using Electrode Electroencephalographic Signals. The Sixth International Conference on Advanced Cognitive Technologies and Applications, ©; 2014. p. 51-5.
Tanaka K, Matsunaga K, Wang HO. Electroencephalogram-based control of an electric wheelchair. Robot IEEE Trans 2005;21:762-6.
Müller-Putz GR, Pfurtscheller G. Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Trans Biomed Eng 2008;55:361-4.
Leeb R, Friedman D, Müller-Putz GR, Scherer R, Slater M, Pfurtscheller G. Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: A case study with a tetraplegic. Comput Intell Neurosci 2007;Article ID 79642. doi:10.1155/2007/79642.
McFarland DJ, Wolpaw JR. EEG-based brain-computer interfaces. Curr Opin Biomed Eng 2017;4:194-200.
Lawhern VJ, Solon AJ, Waytowich NR, Gordon SM, Hung CP, Lance BJ. EEGNet: A compact convolutional neural network for EEG-based brain-computer interfaces. J Neural Eng 2018;15:056013. Back to cited text no. 26
Blankertz B, Dornhege G, Krauledat M, Müller KR, Kunzmann V, Losch F, et al. The Berlin Brain-Computer Interface: EEG-based communication without subject training. IEEE Trans Neural Syst Rehabil Eng 2006;14:147-52.
Fabio B. Brain computer interfaces for communication and control. Front Neurosci 1900;4:767-91.
Lebedev MA, Nicolelis MA. Brain-machine interfaces: Past, present and future. Trends Neurosci 2006;29:536-46.
Vaughan TM, Wolpaw JR, Donchin E. EEG-based communication: Prospects and problems. IEEE Trans Rehabil Eng 1996;4:425-30.
Bhattacharyya S, Konar A, Tibarewala DN. Motor imagery, P300 and error-related EEG-based robot arm movement control for rehabilitation purpose. Med Biol Eng Comput 2014;52:1007-17.
Galán F, Nuttin M, Lew E, Ferrez PW, Vanacker G, Philips J, et al. A brain-actuated wheelchair: Asynchronous and non-invasive Brain-computer interfaces for continuous control of robots. Clin Neurophysiol 2008;119:2159-69.
Park SA, Hwang HJ, Lim JH, Choi JH, Jung HK, Im CH. Evaluation of feature extraction methods for EEG-based brain-computer interfaces in terms of robustness to slight changes in electrode locations. Med Biol Eng Comput 2013;51:571-9.
Jayalakshmi T, Santhakumaran A. Statistical normalization and back propagation for classification. Int J Comput Theory Eng 2011;3:1793-8201.
Almahasneh HS, Kamel N, Malik AS, Wlater N, Chooi WT. EEG Based Driver Cognitive Distraction Assessment. Intelligent and Advanced Systems 2014 5th International Conference On; 2014.
Shojaedini SV, Morabbi S, Keyvanpour M. A New method for detecting P300 signals by using deep learning: hyperparameter tuning in high-dimensional space by minimizing nonconvex error function. J Med Signals Sens 2018;8:205-14.
Huang GB, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 2012;42:513-29.
Huang GB, Zhu Q, Siew C. Extreme learning machine: A new learning scheme of feedforward neural networks. IEEE Int Joint Conf Neural Netw 2004;2:985-90.
Shi LC, Lu BL. EEG-based vigilance estimation using extreme learning machines. Neurocomputing 2013;102:135-143.
Liang NY, Huang GB, Saratchandran P, Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 2006;17:1411-23.
Nataraj SK, Paulraj MP, Bin YS, Adom AH. Thought controlled IRCC using cross-correlation of different frequency band sequence. In 2016 3rd Int Conf Adv Comput Commun Syst 2016;01:1-6.
Guger C, Allison B, Edlinger G. Brain-Computer Interface Research: A State-of-the-art Summary. in Brain-Computer Interface Research, Cham, Switzerland: Springer; 2019. p. 1-9.
Donchin E, Spencer KM, Wijesinghe R. The mental prosthesis: Assessing the speed of a P300-based brain-computer interface. IEEE Trans Rehabil Eng 2000;8:174-9.
Niedermeyer E, da Silva FH. Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. New York: Lippincott Williams and Wilkins; 2005.
Ortner R, Grünbacher E, Guger C. State of the art in Sensors Signals and Signal processing; 2013.
Teplan M. Fundamentals of EEG measurement. Measurement Sci Rev 2002;2:1-11.
Nataraj SK, Yaacob SB, Paulraj MP, Adom AH. EEG Based intelligent robot chair with communication aid using statistical cross correlation based features. IEEE Int Conf Bioinf Biomed (BIBM), Belfast, UK, 2014;12-8.
Aurup GM, Akgunduz A. Pair-wise preference comparisons using alpha-peak frequencies. J Int Design Process Sci 2012;16:3-18.
Nataraj SK, Paulraj MP, Bin Yaacob S, Adom AH. Statistical cross-correlation band features based thought controlled communication system. AI Communications 2016;29:497-511.
Kiymik MK, Güler I, Dizibüyük A, Akin M. Comparison of STFT and wavelet transform methods in determining epileptic seizure activity in EEG signals for real-time application. Comput Biol Med 2005;35:603-16.
Webster J G. Medical instrumentation-application and design. J Clin Eng 1978;3:306.
Siuly S, Li Y. Improving the separability of motor imagery EEG signals using a cross correlation-based least square support vector machine for brain-computer interface. IEEE Trans Neural Syst Rehabil Eng 2012;20:526-38.
Zygierewicz J, Mazurkiewicz J, Durka PJ, Franaszczuk PJ, Crone NE. Estimation of short-time cross-correlation between frequency bands of event related EEG. J Neurosci Methods 2006;157:294-302.
Jervis BW, Coelho M, Morgan GW. Spectral analysis of EEG responses. Med Biol Eng Comput 1989;27:230-8.
Liang NY, Saratchandran P, Huang GB, Sundararajan N. Classification of mental tasks from EEG signals using extreme learning machine. Int J Neural Syst 2006;16:29-38.
Sivanandam M. Introduction to Artificial Neural Networks. India: Vikas publishing House Pvt. Ltd.; 2003.
Fahimi F, Zhang Z, Goh WB, Lee TS, Ang KK, Guan C. Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI. J Neural Eng 2019;16. p. 026007.
Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. Int Joint Conf Articial Int 1995;14:1137-45.
Hema CR, Paulraj MP, Yaacob S, Adom AH, Nagarajan R. Asynchronous brain machine interface-based control of a wheelchair. Adv Exp Med Biol 2011;696:565-72.
Brumberg JS, Kennedy PR, Guenther FH. Artificial Speech Synthesizer Control by Brain-Computer Interface. INTERSPEECH; 2009. p. 636-9.
Guenther FH, Brumberg JS, Wright EJ, Nieto-Castanon A, Tourville JA, Panko M, et al. A wireless brain-machine interface for real-time speech synthesis. PLoS One 2009;4:e8218.
Lahane P, Jagtap J, Inamdar A, Karne N, Dev R. A review of Recent Trends in EEG Based Brain-Computer Interface. IEEE. 2019 International Conference on Computational Intelligence in Data Science; 2019. p. 1-6.
Mohammad M, Hussen HM. The state of the art in feature extraction methods for EEG classification. UHD J Sci Technol 2019;3:16-23.
Refbacks
- There are currently no refbacks.
https://e-rasaneh.ir/Certificate/22728
ISSN : 2228-7477