Statistical Physics Meets Machine Learning II

Presentations

• Scaling Laws and Emergent Behaviors in Foundation Models

  ORAL · Invited

  March 7, 2024, 12:30 PM – March 7, 2024, 1:06 PM

  Presenters

  • Irina Rish

    MILA

  Authors

  • Irina Rish

    MILA

  View abstract →

• Reliable emulation of complex functionals by active learning with error control

  ORAL

  March 7, 2024, 1:06 PM – March 7, 2024, 1:18 PM

  Publication: Fang, X., Gu, M., & Wu, J. (2022). Reliable emulation of complex functionals by active learning with error control. The Journal of Chemical Physics, 157(21).

  Presenters

  • Xinyi Fang

    University of California, Santa Barbara

  Authors

  • Xinyi Fang

    University of California, Santa Barbara

  • Mengyang Gu

    University of California, Santa Barbara

  • Jianzhong Wu

    University of California, Riverside

  View abstract →

• Towards measuring generalization performance of deep neural networks via the Fisher information matrix

  ORAL

  March 7, 2024, 1:18 PM – March 7, 2024, 1:30 PM

  Presenters

  • Chase W Goddard

    Princeton University

  Authors

  • Chase W Goddard

    Princeton University

  • David J Schwab

    The Graduate Center, CUNY

  View abstract →

• Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos

  ORAL

  March 7, 2024, 1:30 PM – March 7, 2024, 1:42 PM

  Presenters

  • Dayal Singh Kalra

    University of Maryland, College Park

  Authors

  • Dayal Singh Kalra

    University of Maryland, College Park

  • Tianyu He

    University of Maryland, College Park

  • Maissam Barkeshli

    University of Maryland, College Park

  View abstract →

• Statistical Mechanics of Semantic Compression

  ORAL · Invited

  March 7, 2024, 1:42 PM – March 7, 2024, 2:18 PM

  Presenters

  • Tankut U Can

    Institute for Advanced Study

  Authors

  • Tankut U Can

    Institute for Advanced Study

  View abstract →

• Bounds on learning with power-law priors

  ORAL

  March 7, 2024, 2:18 PM – March 7, 2024, 2:30 PM

  Presenters

  • Sean A Ridout

    Emory University

  Authors

  • Sean A Ridout

    Emory University

  • Ilya M Nemenman

    Emory, Emory University

  • Ard A Louis

    University of Oxford

  • Chris Mingard

    University of Oxford

  • Radosław Grabarczyk

    University of Oxford

  • Kamaludin Dingle

    Gulf University for Science & Technology

  • Guillermo Valle Pérez

    University of Oxford

  • Charles London

    University of Oxford

  View abstract →

• In-depth analysis of the learning process for a small artificial neural network

  ORAL

  March 7, 2024, 2:30 PM – March 7, 2024, 2:42 PM

  Publication: X. Yang, K. Arora, and M. Bachmann, "Dissecting a Small Artificial Neural Network", preprint (2023).

  Presenters

  • Xiguang Yang

    University of Georgia

  Authors

  • Xiguang Yang

    University of Georgia

  • Krish Arora

    University of Georgia

  • Michael Bachmann

    University of Georgia

  View abstract →

• Understanding Neural Network Generalizability from the Perspective of Entropy

  ORAL

  March 7, 2024, 2:42 PM – March 7, 2024, 2:54 PM

  Publication: Preprint: Correlation between entropy and generalizability in a neural network
  https://arxiv.org/abs/2207.01996

  Presenters

  • Entao Yang

    Air Liquide

  Authors

  • Entao Yang

    Air Liquide

  • Xiaotian Zhang

    City University of Hong Kong

  • Ge Zhang

    City University of Hong Kong

  View abstract →

• Deep Variational Multivariate Information Bottleneck

  ORAL

  March 7, 2024, 2:54 PM – March 7, 2024, 3:06 PM

  Publication: https://openreview.net/forum?id=ZhY1XSYqO4
  https://arxiv.org/abs/2310.03311

  Presenters

  • K. Michael Martini

    Emory University

  Authors

  • K. Michael Martini

    Emory University

  • Eslam Abdelaleem

    Emory University

  • Ilya M Nemenman

    Emory, Emory University

  View abstract →

• Nonlinear classification of neural manifolds with context information: geometrical properties and storage capacity

  ORAL

  March 7, 2024, 3:06 PM – March 7, 2024, 3:18 PM

  Presenters

  • Francesca Mignacco

    CUNY Graduate Center

  Authors

  • Francesca Mignacco

    CUNY Graduate Center

  • Chi-Ning Chou

    Flatiron Institute

  • SueYeon Chung

    New York University

  View abstract →