Learning beyond sensations: how dreams organize neuronal representations.

Deperrois, Nicolas; Petrovici, Mihai A; Senn, Walter; Jordan, Jakob (2024). Learning beyond sensations: how dreams organize neuronal representations. Neuroscience and biobehavioral reviews, 157(105508), p. 105508. Elsevier 10.1016/j.neubiorev.2023.105508

Preview

Text 1-s2.0-S0149763423004773-main.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (1MB) | Preview

Semantic representations in higher sensory cortices form the basis for robust, yet flexible behavior. These representations are acquired over the course of development in an unsupervised fashion and continuously maintained over an organism's lifespan. Predictive processing theories propose that these representations emerge from predicting or reconstructing sensory inputs. However, brains are known to generate virtual experiences, such as during imagination and dreaming, that go beyond previously experienced inputs. Here, we suggest that virtual experiences may be just as relevant as actual sensory inputs in shaping cortical representations. In particular, we discuss two complementary learning principles that organize representations through the generation of virtual experiences. First, "adversarial dreaming" proposes that creative dreams support a cortical implementation of adversarial learning in which feedback and feedforward pathways engage in a productive game of trying to fool each other. Second, "contrastive dreaming" proposes that the invariance of neuronal representations to irrelevant factors of variation is acquired by trying to map similar virtual experiences together via a contrastive learning process. These principles are compatible with known cortical structure and dynamics and the phenomenology of sleep thus providing promising directions to explain cortical learning beyond the classical predictive processing paradigm.

Interest & Impact

Downloads

27 since deposited on 15 Dec 2023
27 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item