Neural Systems III

Presentations

• Associative Memory of Knowledge Structures and Sequences

  ORAL · Invited

  March 15, 2022, 4:00 PM – March 15, 2022, 4:36 PM

  Publication: Julia Steinberg and Haim Sompolinsky. Associative memory of structured knowledge. In preparation

  Presenters

  • Julia A Steinberg

    Princeton University

  Authors

  • Julia A Steinberg

    Princeton University

  • Haim I Sompolinsky

    The Hebrew University of Jerusalem and Harvard University, Hebrew University of Jerusalem, Center for Brain Science, Harvard Univer

  View abstract →

• Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass

  ORAL · Invited

  March 15, 2022, 4:36 PM – March 15, 2022, 5:12 PM

  Publication: G. Dellaferrera, G. Kreiman, Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass, Manuscript in preparation

  Presenters

  • Giorgia Dellaferrera

    Harvard Medical School and Boston Children's Hospital

  Authors

  • Giorgia Dellaferrera

    Harvard Medical School and Boston Children's Hospital

  • Gabriel Kreiman

    Harvard Medical School and Boston Children's Hospital

  View abstract →

• Robust sequential retrieval of memories in interaction-modulated neural networks

  ORAL

  March 15, 2022, 5:12 PM – March 15, 2022, 5:24 PM

  Publication: In preparation.

  Presenters

  • Lukas Herron

    University of Maryland, College Park

  Authors

  • Lukas Herron

    University of Maryland, College Park

  • BingKan Xue

    University of Florida

  • Pablo Sartori

    Gulbenkian Institute

  View abstract →

• Working memory via combinatorial persistent states atop chaos in a random multivariate network

  ORAL

  March 15, 2022, 5:24 PM – March 15, 2022, 5:36 PM

  Publication: Pang, Rich. "Working memory via combinatorial persistent states atop chaos in a random multivariate network." In progress.

  Presenters

  • Rich Pang

    Princeton University

  Authors

  • Rich Pang

    Princeton University

  View abstract →

• Dynamical phases and computation in nonlinear networks with correlated couplings

  ORAL

  March 15, 2022, 5:36 PM – March 15, 2022, 5:48 PM

  Publication: D. Wennberg, S. Ganguli, and H. Mabuchi. Spectra of matrices with partially symmetric randomness. Forthcoming.
  D. Wennberg, A. Yamamura, S. Ganguli, and H. Mabuchi. Forthcoming.

  Presenters

  • Daniel Wennberg

    Stanford University

  Authors

  • Daniel Wennberg

    Stanford University

  • Atsushi Yamamura

    Stanford University

  • Surya Ganguli

    Stanford, Stanford University

  • Hideo Mabuchi

    Stanford University

  View abstract →

• Structured Neural Codes Enable Sample Efficient Learning Through Code-Task Alignment

  ORAL

  March 15, 2022, 5:48 PM – March 15, 2022, 6:00 PM

  Publication: https://www.biorxiv.org/content/10.1101/2021.03.30.437743v1

  Presenters

  • Blake Bordelon

    Harvard University

  Authors

  • Blake Bordelon

    Harvard University

  • Cengiz Pehlevan

    Harvard University

  View abstract →

• Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?

  ORAL

  March 15, 2022, 6:00 PM – March 15, 2022, 6:12 PM

  Publication: arXiv (https://arxiv.org/abs/2110.07472).
  Submitted to ICLR 2022 (https://iclr.cc).

  Presenters

  • Matthew S Farrell

    Harvard University

  Authors

  • Matthew S Farrell

    Harvard University

  • Blake Bordelon

    Harvard University

  • Shubhendu Trivedi

    Massachusetts Institute of Technology

  • Cengiz Pehlevan

    Harvard University

  View abstract →

• Signal representation and learning in random feedback neural networks

  ORAL

  March 15, 2022, 6:12 PM – March 15, 2022, 6:24 PM

  Publication: Susman, L., Mastrogiuseppe, F., Brenner, N., & Barak, O. (2021). Quality of internal representation shapes learning performance in feedback neural networks. Physical Review Research, 3(1), 013176.‏

  Presenters

  • Lee Susman

    Princeton University

  Authors

  • Lee Susman

    Princeton University

  • Francesca Mastrogiuseppe

    University College London

  • Naama Brenner

    Technion Israel Institute of Technology, Technion - Israel Institute of Technolog

  • Omri Barak

    Technion Israel Institute of Technology

  View abstract →

• Understanding multi-pass stochastic gradient descent via dynamical mean-field theory

  ORAL

  March 15, 2022, 6:24 PM – March 15, 2022, 6:36 PM

  Publication: - The effective noise of stochastic gradient descent and how local knowledge of partial information drives complex systems, Francesca Mignacco, Pierfrancesco Urbani, Article in preparation.
  
  - Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem, Francesca Mignacco, Pierfrancesco Urbani, Lenka Zdeborova, Machine Learning: Science and Technology, 2021.
  
  - Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification, Francesca Mignacco, Florent Krzakala, Pierfrancesco Urbani and Lenka Zdeborova, Advances in Neural Information Processing Systems, 2020, vol. 33.
  To appear in the "Machine Learning 2021'' Special Issue, JSTAT.

  Presenters

  • Francesca Mignacco

    Institute of Theoretical Physics, CEA Saclay

  Authors

  • Francesca Mignacco

    Institute of Theoretical Physics, CEA Saclay

  View abstract →

• Nested canalizing functions minimize sensitivity and simultaneously promote criticality

  ORAL

  March 15, 2022, 6:36 PM – March 15, 2022, 6:48 PM

  Publication: arXiv:2109.01117

  Presenters

  • Hamza Coban

    Koc University

  Authors

  • Alkan Kabakcioglu

    Koc University, Koç University

  • Hamza Coban

    Koc University

  View abstract →