Beyond Message Passing: Learning Representations from Dynamics on Graphs

ORAL

Abstract

This talk introduces two complementary frameworks that harness geometric and topological structure in dynamics on graphs for representation learning. I will first introduce Neurospectrum, a modular architecture that models brain activity as graph signals and learns latent neural trajectories shaped by multiscale spatial and temporal structure. By extracting geometric and topological invariants of these naturally occurring dynamics, such as curvature, path signatures, persistent homology, and recurrent dynamics, Neurospectrum reveals interpretable patterns in brain function, offering insights into neural synchrony, coordination, sensory processing, and aberrant dynamics associated with psychiatric disorders like OCD. Building on the idea of using dynamical behavior to reveal structure, I will next introduce DYMAG, a novel graph neural network that replaces traditional message passing with solutions to heat, wave, and chaotic partial differential equations defined over graphs. By treating graphs as continuous dynamical systems, DYMAG captures intrinsic geometric and topological features of the graph, enabling richer node and graph-level representations that improve performance on various benchmarks.

*This work was funded through the Kavli Institute for Neuroscience Postdoctoral Fellowship awarded to Dhananjay Bhaskar at Yale University.

Publication: Bhaskar D, Zhang Y, Moore J, Gao F, Rieck B, Wolf G, Khasawneh F, Munch E, Noah JA, Pushkarskaya H, Pittenger C, Greco V, Krishnaswamy S. Neurospectrum: A Geometric and Topological Deep Learning Framework for Uncovering Spatiotemporal Signatures in Neural Activity. bioRxiv [Preprint]. 2025 https://doi.org/10.1101/2023.03.22.533807.

Bhaskar D, Sun X, Zhang Y, Xu C, Afrasiyabi A, Viswanath S, Fasina O, Nickel M, Wolf G, Perlmutter M, Krishnaswamy S. DYMAG: Rethinking Message Passing Using Dynamical-systems-based Waveforms. arXiv [Preprint]. 2025. https://doi.org/10.48550/arXiv.2309.09924


Presenters

  • Dhananjay Bhaskar

    • University of Wisconsin-Madison

Authors

  • Dhananjay Bhaskar

    • University of Wisconsin-Madison