Hebbian Unlearning and its relation to active dynamics

ORAL

Abstract

In a previous work (arXiv:2203.03024), we showed how endowing an associative memory system with active dynamics can improve the system's information storage and retrieval properties. In the current work, we propose an equivalence between the Hebbian Unlearning algorithm (also known as "dreaming") and modifying dynamics by driving the spins with exponentially correlated noise. Previous attempts to improve the capacity of associative memory models have focused on altering the connections between the neurons. Our method here provides a novel way to increase capacity by changing the dynamics of the neurons instead of altering connection strengths.

Presenters

  • Agnish Kumar Behera

    University of Chicago

Authors

  • Agnish Kumar Behera

    University of Chicago

  • Suriyanarayanan Vaikuntanathan

    University of Chicago

  • Matthew Du

    University of Chicago

  • Daiki Goto

    University of Chicago