Videos

Kinetic Theory: Novel Statistical, Stochastic and Analytical Methods: Flow Maps: Flow-based generative models with lightning-fast inference

Presenter
October 21, 2025
Keywords:
  • Kinetic theory and Stochastic particle systems
  • mean field plasma and radiation dynamics
  • Boltzmann and Landau type equations and systems
  • hydrodynamic limits
  • enhanced dissipation
  • quasi-neutral limits
  • swarming and flocking
  • mean-field games
MSC:
  • 35Bxx - Qualitative properties of solutions to partial differential equations
  • 35Lxx - Hyperbolic equations and hyperbolic systems {For global analysis
  • see 58J45}
  • 35Q20 - Boltzmann equations {For fluid mechanics
  • see 76P05
  • for statistical mechanics
  • see 82B40
  • 82C40
  • 82D05}
  • 35Q35 - PDEs in connection with fluid mechanics
  • 35Q40 - PDEs in connection with quantum mechanics
  • 35Q49 - Transport equations {For calculus of variations and optimal control
  • see 49Q22
  • for fluid mechanics
  • see 76F25
  • see 82C70
  • 82D75
  • for operations research
  • see 90B06
  • for mathematical programming
  • see 90C08}
  • 35Q70 - PDEs in connection with mechanics of particles and systems of particles
  • 35Q82 - PDEs in connection with statistical mechanics
  • 35Q83 - Vlasov equations {For statistical mechanics
  • 82D75}
  • 35Q84 - Fokker-Planck equations {For fluid mechanics
  • see 76X05
  • 76W05
  • see 82C31}
  • 35Q89 - PDEs in connection with mean field game theory {For calculus of variations and optimal control
  • see 49N80
  • for game theory
  • see 91A16}
  • 35Q91 - PDEs in connection with game theory
  • economics
  • social and behavioral sciences
  • 35Q92 - PDEs in connection with biology
  • chemistry and other natural sciences
  • 60Gxx - Stochastic processes
  • 60Hxx - Stochastic analysis [See also 58J65]
  • 70Fxx - Dynamics of a system of particles
  • including celestial mechanics
  • 70Lxx - Random and stochastic aspects of the mechanics of particles and systems
  • 82D05 - Statistical mechanics of gases
  • 82D10 - Statistical mechanics of plasmas
Abstract
Flow-based models have spurred a revolution in generative modeling, driving astounding advancements across diverse domains including high-resolution text to image synthesis and de-novo drug design. Yet despite their remarkable performance, inference in these models requires the solution of a differential equation, which is extremely costly for the large-scale neural network-based models used in practice. In this talk, we introduce a mathematical theory of flow maps, a new class of generative models that directly learn the solution operator for a flow-based model. By learning this operator, flow maps can generate data in 1-4 network evaluations, leading to orders of magnitude faster inference compared to standard flow-based models. We discuss several algorithms for efficiently learning flow maps in practice that emerge from our theory, and we show how many popular recent methods for accelerated inference -- including consistency models, shortcut models, and mean flow -- can be viewed as particular cases of our formalism. We demonstrate the practical effectiveness of flow maps across several tasks including image synthesis, geometric data generation, and inference-time guidance of pre-trained text-to-image models.