Towards Fast Coarse-graining and Equation Discovery with Foundation Inference Models

High-dimensional recordings of dynamical processes are often characterized by a much smaller set of effective variables, evolving on low-dimensional manifolds. Identifying these latent dynamics requires solving two intertwined problems: discovering appropriate coarse-grained variables and simultaneously fitting the governing equations. Most machine learning approaches tackle these tasks jointly by training autoencoders together with models that enforce dynamical consistency. We propose to decouple the two problems by leveraging the recently introduced Foundation Inference Models (FIMs). FIMs are pretrained models that estimate the infinitesimal generators of dynamical systems (e.g., the drift and diffusion of a stochastic differential equation) in zero-shot mode. By amortizing the inference of the dynamics through a FIM with frozen weights, and training only the encoder-decoder map, we define a simple, simulation-consistent loss that stabilizes representation learning. A proof of concept on a stochastic double-well system with semicircle diffusion, embedded into synthetic video data, illustrates the potential of this approach for fast and reusable coarse-graining pipelines.

  • Published in:
    AI in Science Summit 2025
  • Type:
    Article
  • Authors:
    Hinz, Manuel; Mauel, Maximilian; Seifner, Patrick; Berghaus, David; Cvejoski, Kostadin; Sanchez, Ramses
  • Year:
    2025
  • Source:
    https://arxiv.org/abs/2510.12618

Citation information

Hinz, Manuel; Mauel, Maximilian; Seifner, Patrick; Berghaus, David; Cvejoski, Kostadin; Sanchez, Ramses: Towards Fast Coarse-graining and Equation Discovery with Foundation Inference Models, AI in Science Summit 2025, 2025, November, https://arxiv.org/abs/2510.12618, Hinz.etal.2025a,

Associated Lamarr Researchers

Photo. Portrait of David Berghaus.

Dr. David Berghaus

Postdoctoral Researcher NLP to the profile
Ramsés Sánchez

Dr. Ramsés Sánchez

Scientific Coordinator Hybrid ML to the profile