A realistic framework for investigating decision-making in the brain with high spatio-temporal resolution using simultaneous EEG/fMRI and joint ICA.

Kyathanahally, Sreenath Pruthviraj; Franco-Watkins, Ana; Zhang, Xiaoxia; Calhoun, Vince; Deshpande, Gopikrishna (2017). A realistic framework for investigating decision-making in the brain with high spatio-temporal resolution using simultaneous EEG/fMRI and joint ICA. IEEE journal of biomedical and health informatics, 21(3), pp. 814-825. Institute of Electrical and Electronics Engineers 10.1109/JBHI.2016.2590434

[img] Text
07509628.pdf - Published Version
Restricted to registered users only
Available under License Publisher holds Copyright.

Download (4MB) | Request a copy

Human decision-making is a multidimensional construct, driven by a complex interplay between external factors, internal biases and computational capacity constraints. Here we propose a layered approach to experimental design in which multiple tasks - from simple to complex - with additional layers of complexity introduced at each stage, are incorporated for investigating decision-making. This is demonstrated using tasks involving intertemporal choice between immediate and future prospects. Previous functional magnetic resonance imaging (fMRI) and electroencephalographic (EEG) studies have separately investigated the spatial and temporal neural substrates, respectively, of specific factors underlying decision making. In contrast, we performed simultaneous acquisition of EEG/fMRI data and fusion of both modalities using joint independent component analysis (jICA) such that: (i) the native temporal/spatial resolutions of either modality is not compromised and (ii) fast temporal dynamics of decision-making as well as involved deeper striatal structures can be characterized. We show that spatio-temporal neural substrates underlying our proposed complex intertemporal task simultaneously incorporating rewards, costs and uncertainty of future outcomes can be predicted (using a linear model) from neural substrates of each of these factors, which were separately obtained by simpler tasks. This was not the case for spatial and temporal features obtained separately from fMRI and EEG respectively. However, certain prefrontal activations in the complex task could not be predicted from activations in simpler tasks, indicating that the assumption of pure insertion has limited validity. Overall, our approach provides a realistic and novel framework for investigating the neural substrates of decision making with high spatio-temporal resolution.

Item Type:

Journal Article (Original Article)


04 Faculty of Medicine > Department of Radiology, Neuroradiology and Nuclear Medicine (DRNN) > Institute of Diagnostic, Interventional and Paediatric Radiology > DCR Magnetic Resonance Spectroscopy and Methodology (AMSM)

Graduate School:

Graduate School for Cellular and Biomedical Sciences (GCB)

UniBE Contributor:

Kyathanahally, Sreenath Pruthviraj




Institute of Electrical and Electronics Engineers




Christoph Hans Boesch

Date Deposited:

30 Mar 2017 15:33

Last Modified:

04 Feb 2019 08:19

Publisher DOI:


PubMed ID:






Actions (login required)

Edit item Edit item
Provide Feedback