Slow stochastic learning with global inhibition: a biological solution to the binary perceptron problem

Senn, Walter; Fusi, Stefano (2004). Slow stochastic learning with global inhibition: a biological solution to the binary perceptron problem. Neurocomputing, 58-60, pp. 321-326. Elsevier 10.1016/j.neucom.2004.01.062

Text 1-s2.0-S092523120400058X-main.pdf - Published Version Restricted to registered users only Available under License Publisher holds Copyright. Download (203kB)

Networks of neurons connected by plastic all-or-none synapses tend to quickly forget previously acquired information when new patterns are learned. This problem could be solved for random uncorrelated patterns by randomly selecting a small fraction of synapses to be modified upon each stimulus presentation (slow stochastic learning). Here we show that more complex, but still linearly separable patterns, can be learned by networks with binary excitatory synapses in a finite number of presentations provided that: (1) there is non-vanishing global inhibition, (2) the binary synapses are changed with small enough probability (slow learning) only when the output neuron does not give the desired response (as in the classical perceptron rule) and (3) the neuronal threshold separating the total synaptic inputs corresponding to different classes is small enough.

Interest & Impact

Downloads

2 since deposited on 18 Jan 2023
0 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item