Hebbian Unlearning and its relation to active dynamics
ORAL
Abstract
In a previous work (arXiv:2203.03024), we showed how endowing an associative memory system with active dynamics can improve the system's information storage and retrieval properties. In the current work, we propose an equivalence between the Hebbian Unlearning algorithm (also known as "dreaming") and modifying dynamics by driving the spins with exponentially correlated noise. Previous attempts to improve the capacity of associative memory models have focused on altering the connections between the neurons. Our method here provides a novel way to increase capacity by changing the dynamics of the neurons instead of altering connection strengths.
–
Presenters
-
Agnish Kumar Behera
University of Chicago
Authors
-
Agnish Kumar Behera
University of Chicago
-
Suriyanarayanan Vaikuntanathan
University of Chicago
-
Matthew Du
University of Chicago
-
Daiki Goto
University of Chicago