Implementation of Kolmogorov Flow Matching in a GFlowNet Learning Model

ORAL

Abstract

Sampling from high-dimensional probability distributions remains a major challenge due to the difficulty of estimating partition functions. Recently proposed Generative Flow Networks (GFlowNets) provide a new method to sample compositional structures efficiently. Standard GFlowNet algorithms solve the sampling problem by assuming an equilibrium model and finding a flow function that satisfies detailed balance. As such, these traditional training objectives depend on estimating forward and backward transition probabilities, flow functions, and the partition function.

We present a new Kolmogorov flow objective function, which bypasses this limitation by enforcing cycle consistency between forward and backward transition probabilities.  This approach allows us to learn equilibrium flow rates without the need for normalization from the partition function, while still yielding stable learning dynamics and performance comparable to trajectory balance, the current preferred learning objective.  This new objective thus establishes a bridge between statistical mechanics and generative modeling, and has promising applications to energy-based and entropy-regularized systems.

*The authors acknowledge funding support from the NSF through Award No. PHY-2425180

Presenters

  • Sergio Cuadra

    • University of Massachusetts Boston

Authors

  • Sergio Cuadra

    • University of Massachusetts Boston
  • Sho Inaba

    • Department of Physics, Universtiy of Massachusetts Boston
    • University of Massachusetts Boston
  • Jacob Adamczyk

    • University of Massachusetts Boston
  • Rahul V Kulkarni

    • Department of Physics, University of Massachusetts Boston
    • University of Massachusetts Boston