Providing a Four-layer Method Based on Deep Belief Network to Improve Emotion Recognition in Electroencephalography in Brain Signals

Seyed Mohammad Reza Mousavinasr, Ali Pourmohammad, Mohammad Sadegh Moayed Saffari

DOI: 10.4103/jmss.JMSS_34_17

Abstract


Background: One of the fields of research in recent years that has been under focused is emotion recognition in electroencephalography (EEG) signals. This study provides a four-layer method to improve people's emotion recognition through these signals and deep belief neural networks. Methods: In this study, DEAP dataset is used and a four-layer method includes (1) preprocessing, (2) extracting features, (3) dimension reduction, and (4) emotion identification and estimation. To find the optimal choice in some of the steps of these layers, different tests have been conducted. In this study, three different tests have been conducted. The first is finding the perfect window in feature extraction section that resulted in superiority of Hamming window to the other windows. The second is choosing the most appropriate number of filter bank and the best result was 26. The third test was also emotion recognition that its accuracy was 92.93 for arousal dimension, 92.64 for valence dimension, and 93.14 for dominance dimension in two-class experiment and 76.28 for the arousal, 74.83 for the valence, and 75.64 for dominance in three-class experiment. Results: The results of this method show an improvement of 12.34% and 7.74% in two- and three-class levels in the arousal dimension. This improvement in the valence is 12.77 and 8.52, respectively. Conclusion: The results show that the proposed method can be used to improve the accuracy of emotion recognition.


Keywords


Deep belief neural network; deep neural network; electroencephalography; emotion recognition; independent component analysis

Full Text:

PDF

References


Russell JA. A circumplex model of affect. J Pers Soc Psychol 1980;39:1161-78.

Imani E, Pourmohammad A, Bagheri M, Mobasheri V. ICA-based imagined conceptual words classification on EEG signals. J Med Signals Sens 2017;7:130-44.

Hatamikia S, Maghooli K, Nasrabadi AM. The emotion recognition system based on autoregressive model and sequential forward feature selection of electroencephalogram signals. J Med Signals Sens 2014;4:194-201.

Soleymani M, Lichtenauer J, Pun T, Pantic M. A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 2012;3:42-55.

Liu YH, Wu CT, Cheng WT, Hsiao YT, Chen PM, Teng JT, et al. Emotion recognition from single-trial EEG based on kernel Fisher's emotion pattern and imbalanced quasiconformal kernel support vector machine. Sensors (Basel) 2014;14:13361-88.

Petrantonakis PC, Hadjileontiadis LJ. A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition. IEEE Trans Inf Technol Biomed 2011;15:737-46.

Lin YP, Wang CH, Wu TL, Jeng SK, Chen JH. “EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine,” 2009 IEEE International Conference on Acoustics, Speech and Signal Processing 2009.

Koelstra S. Deap: A database for emotion analysis; using physiological signals. Affect Comput 2012;3:18-31.

Hosseini SA, Naghibi-Sistani MB. Emotion recognition method using entropy analysis of EEG signals. Int J Image Graph Signal Process 2011;5:30-6.

Nie D, Wang XW, Shi LC, Lu BL. EEG-Based Emotion Recognition During Watching Movies. 2011 5th International IEEE/EMBS Conference on Neural Engineering (NER); 2011. p. 667-70.

Huang D, Guan C, Ang KK, Zhang H, Pan Y. Asymmetric Spatial Pattern for EEG-based emotion detection. Proceeding International Joint Conference on Neural Networks; 2012. p. 10-5.

Sohaib AT, Qureshi S, Hagelbäck J, Hilborn O, Jercic P. Evaluating classifiers for emotion recognition using EEG. Lect Notes Comput Sci 2013;8027:492-501.

Liu Y, Sourina O. EEG Databases for Emotion Recognition. Proceeding – 2013 International Conference on Cyberworlds (CW 2013); 2013.p. 302-9.

Zheng WL, Zhu JY, Peng Y, Lu BL. EEG-based emotion classification using deep belief networks. In 2014 IEEE International Conference on Multimedia and Expo (ICME); 2014. p. 1-6.

Lan Z, Sourina O, Wang L, Liu Y. Real-time eeg-based emotion monitoring using stable features, The Visual Computer, 2016;32:347-58.

Mehmood RM, Lee HJ. EEG based emotion recognition from human brain using Hjorth parameters and SVM. Int J Bio Sci Bio Technol 2015;7:23-32.

Petrantonakis PC, Hadjileontiadis LJ. Emotion recognition from EEG using higher order crossings. IEEE Trans Inf Technol Biomed 2010;14:186-97.

Khosrowabadi R, Heijnen M, Wahab A, Quek HC. The dynamic emotion recognition system based on functional connectivity of brain regions. Emotion 2010;639798:377-81.

Khosrowabadi R, Rahman AW. Classification of EEG Correlates on Emotion using Features from Gaussian Mixtures of EEG Spectrogram. Proceeding 3rd International Conference on Information and Communication Technologies. Moslem World; 2010. p. E102-7.

Jirayucharoensak S, Pan-Ngum S, Israsena P. EEG-based emotion recognition using deep learning network with principal component based covariate shift adaptation. ScientificWorldJournal 2014;2014:627892.

Park MS, Oh HS, Jeong H, Sohn JH. Eeg-Based Emotion Recogntion during Emotionally Evocative Films. In: 2013 International Winter Workshop on Brain-Computer Interface (BCI); 2013. p. 56-7.

Yoon HJ, Chung SY. EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm. Comput Biol Med 2013;43:2230-7.

Keyvanrad MA, Homayounpour MM. A Brief Survey on Deep Belief Networks and Introducing a New Object Oriented MATLAB Toolbox (DeeBNet), Preprint, arXiv: 1408.3264; 2014.


Refbacks

  • There are currently no refbacks.


 

  https://e-rasaneh.ir/Certificate/22728

https://e-rasaneh.ir/

ISSN : 2228-7477