Convolutional neural networks for decoding electroencephalography responses and visualizing trial by trial changes in discriminant features.

Aellen, Florence Marcelle; Göktepe, Pinar; Apostolopoulos, Stefanos; Tzovara, Athina (2021). Convolutional neural networks for decoding electroencephalography responses and visualizing trial by trial changes in discriminant features. Journal of neuroscience methods, 364, p. 109367. Elsevier 10.1016/j.jneumeth.2021.109367

Preview

Text Aellen__2021__Convolutional_neural_networks.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (11MB) | Preview

BACKGROUND

Deep learning has revolutionized the field of computer vision, where convolutional neural networks (CNNs) extract complex patterns of information from large datasets. The use of deep networks in neuroscience is mainly focused to neuroimaging or brain computer interface -BCI- applications. In electroencephalography (EEG) research, multivariate pattern analysis (MVPA) mainly relies on linear algorithms, which require a homogeneous dataset and assume that discriminant features appear at consistent latencies and electrodes across trials. However, neural responses may shift in time or space during an experiment, resulting in under-estimation of discriminant features. Here, we aimed at using CNNs to classify EEG responses to external stimuli, by taking advantage of time- and space- unlocked neural activity, and at examining how discriminant features change over the course of an experiment, on a trial by trial basis.

NEW METHOD

We present a novel pipeline, consisting of data augmentation, CNN training, and feature visualization techniques, fine-tuned for MVPA on EEG data.

RESULTS

Our pipeline provides high classification performance and generalizes to new datasets. Additionally, we show that the features identified by the CNN for classification are electrophysiologically interpretable and can be reconstructed at the single-trial level to study trial-by-trial evolution of class-specific discriminant activity.

COMPARISON WITH EXISTING TECHNIQUES

The developed pipeline was compared to commonly used MVPA algorithms like logistic regression and support vector machines, as well as to shallow and deep convolutional neural networks. Our approach yielded significantly higher classification performance than existing MVPA techniques (p = 0.006) and comparable results to other CNNs for EEG data.

CONCLUSION

In summary, we present a novel deep learning pipeline for MVPA of EEG data, that can extract trial-by-trial discriminative activity in a data-driven way.

Interest & Impact

Downloads

98 since deposited on 06 Dec 2021
39 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item