Videos

Benjamin Zhang - Probabilistic operator learning: generative modeling and uncertainty quantification

Presenter
July 15, 2025
Abstract
Recorded 15 July 2025. Benjamin Zhang of Brown University presents "Probabilistic operator learning: generative modeling and uncertainty quantification for in-context operator learning" at IPAM's Sampling, Inference, and Data-Driven Physical Modeling in Scientific Machine Learning Workshop. Abstract: In-context operator networks (ICON) are a class of non-intrusive operator learning methods based on the novel architectures of foundation models. Trained on a diverse set of datasets of initial and boundary conditions paired with corresponding solutions to ordinary and partial differential equations (ODEs and PDEs), ICON learns to map example condition-solution pairs of a given differential equation to an approximation of its solution operator. In this talk, we present a probabilistic framework that reveals ICON as implicitly performing Bayesian inference, where it computes the mean of the posterior predictive distribution over solution operators conditioned on the provided context (example condition-solution pairs). By modeling the dependence of example pairs through random differential equations, we formalize how, given example condition-solution pairs, ICON is a point estimate of the posterior predictive distribution over operators. This probabilistic perspective provides a basis for extending ICON to generative settings, where one can sample from the posterior predictive distribution over solution operators. As a result, ICON is no longer limited to point prediction, as it can capture the underlying uncertainty in the solution operator. This enables principled uncertainty quantification in operator learning by using generative modeling to produce confidence intervals for predictive solutions. Learn more online at: https://www.ipam.ucla.edu/programs/workshops/sampling-inference-and-data-driven-physical-modeling-in-scientific-machine-learning-2/