Language Models and Foundation Models for Physics Applications

Presentations

• Analytic Theories of Creativity and Generalization in Diffusion Models

  Invited-In-person · Invited

  March 17, 2026, 8:00 AM – March 17, 2026, 8:36 AM

  Publication: Kamb, M., & Ganguli, S. An analytic theory of creativity in convolutional diffusion models. In Forty-second International Conference on Machine Learning.

  Presenters

  • Mason Kamb

    • Stanford University

  Authors

  • Mason Kamb

    • Stanford University

  • Surya Ganguli

    • Stanford University

  View abstract →

• A machine learning perspective on microscopic models for materials: Hamiltonian learning and simulation using neural quantum states

  Invited-In-person · Invited

  March 17, 2026, 8:36 AM – March 17, 2026, 9:12 AM

  Publication: [1] https://arxiv.org/abs/2509.06947
  [2] https://arxiv.org/abs/2411.10430

  Presenters

  • Annabelle Bohrdt

    • LMU Munich

  Authors

  • Annabelle Bohrdt

    • LMU Munich

  • Hannah Lange

  • Annika Böhler

  • Christopher Roth

    • Simons Foundation (Flatiron Institute)

  • Tizian Blatz

    • LMU Munich

  • Sebastian Paeckel

    • Ludwig-Maximilians-Universitaet (LMU-Munich)

  • Ulrich Schollwöck

  View abstract →

• Expert-Grounded Prompt Engineering for Extracting Lattice Constants of High Entropy Alloys from Scientific Publications using Large Language Models

  Oral-In-person

  March 17, 2026, 9:12 AM – March 17, 2026, 9:24 AM

  Presenters

  • Shunshun Liu

    • University of Virginia

  Authors

  • Shunshun Liu

    • University of Virginia

  • Talon Booth

  • Yangfeng Ji

  • Wesley Reinhart

    • Pennsylvania State University

  • Prasanna Balachandran

  View abstract →

• MORPH: Shape-Agnostic Foundation Models for Heterogeneous PDE Systems

  Oral-In-person

  March 17, 2026, 9:24 AM – March 17, 2026, 9:36 AM

  Publication: Rautela, Mahindra Singh, et al. "MORPH: Shape-agnostic PDE Foundation Models." arXiv preprint arXiv:2509.21670 (2025).

  Presenters

  • Mahindra Rautela

    • Los Alamos National Laboratory

  Authors

  • Mahindra Rautela

    • Los Alamos National Laboratory

  • Alexander Most

  • Siddharth Mansingh

  • Bradley Love

  • Diane Oyen

    • Los Alamos National Lab

  • Earl Lawrence

  • Ayan Biswas

    • Los Alamos National Laboratory

  View abstract →

• Towards a formally verified framework for quantum physics in the age of artificial intelligence using Lean4

  Oral-In-person

  March 17, 2026, 9:36 AM – March 17, 2026, 9:48 AM

  Presenters

  • Leopoldo Sarra

    • Axiomatic AI

  Authors

  • Izan Beltran Ferreiro

  • Austin Letson

  • Krystian Nowakowski

  • Borja Requena Pozo

  • Leopoldo Sarra

    • Axiomatic AI

  View abstract →

• Resolving Multi-Level Discrepancies in Information Extraction: Foundation Models for Autonomous Interdisciplinary Literature Analysis in Physics

  Oral-In-person

  March 17, 2026, 9:48 AM – March 17, 2026, 10:00 AM

  Presenters

  • Jian Yang

    • Westlake Corp.

  Authors

  • Jian Yang

    • Westlake Corp.

  • Michael Dessauer

  • Constantyn Chalitsios

  View abstract →

• Probing the Critical Point (CritPt) of AI Reasoning: Benchmarking LLMs at the Frontier of Physics

  Oral-In-person

  March 17, 2026, 10:00 AM – March 17, 2026, 10:12 AM

  Publication: Zhu, M., Tian, M., Yang, X., Zhou, T., Zhu, P., Chertkov, E., ... & Peng, H. (2025). Probing the Critical Point (CritPt) of AI Reasoning: a Frontier Physics Research Benchmark. arXiv preprint arXiv:2509.26574.

  Presenters

  • Minhui Zhu

    • Argonne National Laboratory

  Authors

  • Minhui Zhu

    • Argonne National Laboratory

  • Minyang Tian

  • Xiaocheng Yang

  • Tianci Zhou

    • Massachusetts Institute of Technology

  • Penghao Zhu

  • Eli Chertkov

  • Shengyan Liu

    • University of Illinois at Urbana-Champaign

  • Yufeng Du

  • Lifan Yuan

  • Ziming Ji

  • Indranil Das

    • University of Illinois at Urbana-Champaign

  • Junyi Cao

    • University of Illinois at Urbana-Champaign

  • Yufeng Du

  • Jinchen He

    • University of Maryland College Park

  • Yifan Su

    • Massachusetts Institute of Technology

  • Peixue Wu

  • Jiabin Yu

    • University of Florida

  • Yikun Jiang

  • Yujie Zhang

  • Chang Liu

    • University of Connecticut

  • Daniel Inafuku

    • University of Illinois at Urbana-Champaign

  • Nicholas Chia

  • Eliu Huerta

    • Argonne National Laboratory

  • Hao Peng

  View abstract →

• Mutual Information Scaling Law for Long-Context Language Modeling

  Oral-In-person

  March 17, 2026, 10:12 AM – March 17, 2026, 10:24 AM

  Publication: https://arxiv.org/abs/2503.04725
  https://neurips.cc/virtual/2025/poster/115721

  Presenters

  • Zhuo Chen

    • Massachusetts Institute of Technology

  Authors

  • Zhuo Chen

    • Massachusetts Institute of Technology

  • Oriol Mayné i Comas

  • Zhuotao Jin

  • Di Luo

  • Marin Soljacic

  View abstract →

• AI-Fitter: LLM-Assisted Curve Fitting for Physics Research Without Manual Initialization

  Oral-In-person

  March 17, 2026, 10:24 AM – March 17, 2026, 10:36 AM

  Presenters

  • Allison Cao

    • Portland State University

  Authors

  • Allison Cao

    • Portland State University

  • Kacharat Supichayanggoon

  • Andres La Rosa

  View abstract →