Short-time-span EEG-based personalized emotion recognition with deep convolutional neural network

Abstract

Emotion recognition can be useful in various applications such as in neurofeedback training for functional enhancement. A practically realizable emotion recognition system should rely on as little physiological signals/modalities as possible. Also, emotion-related neurological activities may be vastly different from person to person. Hence, this paper presents the single-modal EEG-based personalized emotion recognition convolutional neural network (CNN) models working on the DEAP dataset. The valence and arousal level classification performance of our presented CNN classifiers have surpassed the other emotion classifiers working on the DEAP dataset based on our scope of literature reviewed. The models, which are deep CNN, rely on only plain EEG data and require no pre-extracted EEG features. The design and application of the CNN models is aimed at possible future work of identification of new emotion-related EEG features, relying on the automated feature extraction capability of the CNN. The two CNN models presented have achieved the 3-class valence classification test accuracy of 97.59% and 98.75% respectively, and the 3-class arousal classification test accuracy of 98.48% and 97.58%.