Kinetic Theory: Novel Statistical, Stochastic and Analytical Methods: Flow Maps: Flow-based generative models with lightning-fast inference
Presenter
October 21, 2025
Keywords:
- Kinetic theory and Stochastic particle systems
- mean field plasma and radiation dynamics
- Boltzmann and Landau type equations and systems
- hydrodynamic limits
- enhanced dissipation
- quasi-neutral limits
- swarming and flocking
- mean-field games
MSC:
- 35Bxx - Qualitative properties of solutions to partial differential equations
- 35Lxx - Hyperbolic equations and hyperbolic systems {For global analysis
- see 58J45}
- 35Q20 - Boltzmann equations {For fluid mechanics
- see 76P05
- for statistical mechanics
- see 82B40
- 82C40
- 82D05}
- 35Q35 - PDEs in connection with fluid mechanics
- 35Q40 - PDEs in connection with quantum mechanics
- 35Q49 - Transport equations {For calculus of variations and optimal control
- see 49Q22
- for fluid mechanics
- see 76F25
- see 82C70
- 82D75
- for operations research
- see 90B06
- for mathematical programming
- see 90C08}
- 35Q70 - PDEs in connection with mechanics of particles and systems of particles
- 35Q82 - PDEs in connection with statistical mechanics
- 35Q83 - Vlasov equations {For statistical mechanics
- 82D75}
- 35Q84 - Fokker-Planck equations {For fluid mechanics
- see 76X05
- 76W05
- see 82C31}
- 35Q89 - PDEs in connection with mean field game theory {For calculus of variations and optimal control
- see 49N80
- for game theory
- see 91A16}
- 35Q91 - PDEs in connection with game theory
- economics
- social and behavioral sciences
- 35Q92 - PDEs in connection with biology
- chemistry and other natural sciences
- 60Gxx - Stochastic processes
- 60Hxx - Stochastic analysis [See also 58J65]
- 70Fxx - Dynamics of a system of particles
- including celestial mechanics
- 70Lxx - Random and stochastic aspects of the mechanics of particles and systems
- 82D05 - Statistical mechanics of gases
- 82D10 - Statistical mechanics of plasmas
Abstract
Flow-based models have spurred a revolution in generative modeling, driving astounding advancements across diverse domains including high-resolution text to image synthesis and de-novo drug design. Yet despite their remarkable performance, inference in these models requires the solution of a differential equation, which is extremely costly for the large-scale neural network-based models used in practice. In this talk, we introduce a mathematical theory of flow maps, a new class of generative models that directly learn the solution operator for a flow-based model. By learning this operator, flow maps can generate data in 1-4 network evaluations, leading to orders of magnitude faster inference compared to standard flow-based models. We discuss several algorithms for efficiently learning flow maps in practice that emerge from our theory, and we show how many popular recent methods for accelerated inference -- including consistency models, shortcut models, and mean flow -- can be viewed as particular cases of our formalism. We demonstrate the practical effectiveness of flow maps across several tasks including image synthesis, geometric data generation, and inference-time guidance of pre-trained text-to-image models.