PoS - Proceedings of Science
Volume 300 - Information Science and Cloud Computing (ISCC 2017) - Session I machine learning
Research on Multimodal Emotion Recognition Platform Construction
W. Liu*, H. Jiang and Y. Lu
Full text: pdf
Pre-published on: February 26, 2018
Published on: March 08, 2018
Abstract
With the development of BCI technology, simple non-behavioral human-computer interaction has been achieved. However, due to the low signal-to-noise ratio and time-varying nature of EEG signals, the existing signal processing algorithms is inadequate for online applications. This has become the bottleneck that restricts the development of man-machine integrated system based on brain-computer interface technology.We realized that a single state of mind measurement technology would be very difficult to achieve efficient brain-computer integrated system, therefore, the multi-modality measurement fusion technology is an inevitable trend.At present, researches on affective recognition are mainly based on single signal, while the multi-modal emotion recognition combining with multiple signals needs to be further studied. This article describes a multi-modal synchronous acquisition cognitive experiment platform. The platform uses three independent signal acquisition and analysis systems of EEG, eye movement and expression monitoring, and realizes the accurate synchronization of three types of signals based on EEG with the self-developed synchronization module. The EEG, eye movement and facial expression information can be effectively and efficiently standardized to form a large-scale multi-ethnic cognitive database so as to facilitate the standardization of cognitive experiments, especially affective recognition.
DOI: https://doi.org/10.22323/1.300.0015
How to cite

Metadata are provided both in "article" format (very similar to INSPIRE) as this helps creating very compact bibliographies which can be beneficial to authors and readers, and in "proceeding" format which is more detailed and complete.

Open Access
Creative Commons LicenseCopyright owned by the author(s) under the term of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.