Neurons Equipped with Intrinsic Plasticity Learn Stimulus Intensity Statistics
Travis Monk, Cristina Savin, Jörg Lücke
Abstract
Experience constantly shapes neural circuits through a variety of plasticity mechanisms. While the functional roles of some plasticity mechanisms are well-understood, it remains unclear how changes in neural excitability contribute to learning. Here, we develop a normative interpretation of intrinsic plasticity (IP) as a key component of unsupervised learning. We introduce a novel generative mixture model that accounts for the class-specific statistics of stimulus intensities, and we derive a neural circuit that learns the input classes and their intensities. We will analytically show that inference and learning for our generative model can be achieved by a neural circuit with intensity-sensitive neurons equipped with a specific form of IP. Numerical experiments verify our analytical derivations and show robust behavior for artificial and natural stimuli. Our results link IP to non-trivial input statistics, in particular the statistics of stimulus intensities for classes to which a neuron is sensitive. More generally, our work paves the way toward new classification algorithms that are robust to intensity variations.
BibTeX
@inproceedings{NIPS2016_3b92d18a,
author = {Monk, Travis and Savin, Cristina and L\"{u}cke, J\"{o}rg},
booktitle = {Advances in Neural Information Processing Systems},
editor = {D. Lee and M. Sugiyama and U. Luxburg and I. Guyon and R. Garnett},
pages = {},
publisher = {Curran Associates, Inc.},
title = {Neurons Equipped with Intrinsic Plasticity Learn Stimulus Intensity Statistics},
url = {https://proceedings.neurips.cc/paper_files/paper/2016/file/3b92d18aa7a6176dd37d372bc2f1eb71-Paper.pdf},
volume = {29},
year = {2016}
}