Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Non-invasive and Low Cost Way
López Gil, Juan Miguel
Virgili Gomà, Jordi
Guilera Lladós, Teresa
MetadataShow full item record
Technical advances, particularly the integration of wearable and embedded sensors, facilitate tracking of physiological responses in a less intrusive way. Currently, there are many devices that allow gathering biometric measurements from human beings, such as EEG Headsets or Health Bracelets. The massive data sets generated by tracking of EEG and physiology may be used, among other things, to infer knowledge about human moods and emotions. Apart from direct biometric signal measurement, eye tracking systems are nowadays capable of determining the point of gaze of the users when interacting in ICT environments, which provides an added value research on many different areas, such as psychology or marketing. We present a process in which devices for eye tracking, biometric, and EEG signal measurements are synchronously used for studying both basic and complex emotions. We selected the least intrusive devices for different signal data collection given the study requirements and cost constraints, so users would behave in the most natural way possible. On the one hand, we have been able to determine basic emotions participants were experiencing by means of valence and arousal. On the other hand, a complex emotion such as empathy has also been detected. To validate the usefulness of this approach, a study involving forty-four people has been carried out, where they were exposed to a series of affective stimuli while their EEG activity, biometric signals, and eye position were synchronously recorded to detect self-regulation. The hypothesis of the work was that people who self-regulated would show significantly different results when analyzing their EEG data. Participants were divided into two groups depending on whether Electro Dermal Activity (EDA) data indicated they self-regulated or not. The comparison of the results obtained using different machine learning algorithms for emotion recognition shows that using EEG activity alone as a predictor for self-regulation does not allow properly determining whether a person in self-regulation its emotions while watching affective stimuli. However, adequately combining different data sources in a synchronous way to detect emotions makes it possible to overcome the limitations of single detection methods.
Is part ofFrontiers in Computational Neurosciencie, 2016
European research projects
The following license files are associated with this item:
Showing items related by title, author, creator and subject.
Guilera Lladós, Teresa; Batalla, Iolanda; Soler González, Jorge (Elsevier, 2017)Introduction: The evolution of empathy among medical students according to gender and specialty preference is explored using several validated scales. The value of our feedback to the medical students at the end of the ...
Empathy and big five personality model in medical students and its relationship to gender and specialty preference: a cross-sectional study Guilera Lladós, Teresa; Batalla, Iolanda; Forné Izquierdo, Carles; Soler González, Jorge (BioMed Central, 2019)Background:Given the influence that personality can have on empathy, this study explores the relationshipbetween empathy and personality, using three different measures of empathy, and taking into account gender andspecialty ...
Guilera Lladós, Teresa; Batalla, Iolanda; Soler González, Jorge (Fundación Educación Médica, 2017)Objetivo. Identifi car las emociones que experimentan los estudiantes de medicina en el contexto de deprivación sensorial para mejorar la empatía. Sujetos y métodos. Se presenta el programa del taller (deprivación visual, ...