Transport Based Mean Flows for Generative Modeling

Generative AI & LLMs
Published: arXiv: 2509.22592v1
Authors

Elaheh Akbari Ping He Ahmadreza Moradipari Yikun Bai Soheil Kolouri

Abstract

Flow-matching generative models have emerged as a powerful paradigm for continuous data generation, achieving state-of-the-art results across domains such as images, 3D shapes, and point clouds. Despite their success, these models suffer from slow inference due to the requirement of numerous sequential sampling steps. Recent work has sought to accelerate inference by reducing the number of sampling steps. In particular, Mean Flows offer a one-step generation approach that delivers substantial speedups while retaining strong generative performance. Yet, in many continuous domains, Mean Flows fail to faithfully approximate the behavior of the original multi-step flow-matching process. In this work, we address this limitation by incorporating optimal transport-based sampling strategies into the Mean Flow framework, enabling one-step generators that better preserve the fidelity and diversity of the original multi-step flow process. Experiments on controlled low-dimensional settings and on high-dimensional tasks such as image generation, image-to-image translation, and point cloud generation demonstrate that our approach achieves superior inference accuracy in one-step generative modeling.

Paper Summary

Problem
Generative models are powerful tools for creating realistic data, but they often come with a slow inference speed, which makes them impractical for real-world applications. This is particularly true for flow-matching generative models, which require multiple sequential sampling steps to generate new data. This slow speed limits their potential in applications where fast generation is crucial.
Key Innovation
Researchers have developed a new approach called Optimal Transport-based Mean Flow (OT-MF) that addresses this limitation. OT-MF combines the benefits of optimal transport and mean flow matching to create a one-step generation approach that is both fast and accurate. This new framework unifies two existing methods, optimal transport conditional flow matching and mean flow matching, under a common formulation.
Practical Impact
The OT-MF approach has significant practical implications for various applications, including image and point cloud generation, image-to-image translation, and other continuous data generation tasks. By providing a principled way to construct target average velocity fields, OT-MF can generate more robust and higher-quality results in one-step generative modeling. This can lead to faster and more efficient data generation, which is essential in many real-world applications, such as computer vision, robotics, and data augmentation.
Analogy / Intuitive Explanation
Think of generative models as a way to transform a simple source distribution (like a Gaussian) into a complex target distribution (like natural images). Flow-matching models use an ordinary differential equation (ODE) to continuously transform the source distribution into the target. The new OT-MF approach can be thought of as a way to optimize this transformation process, using optimal transport to find the best way to move the source distribution to the target distribution in a single step. This is like using a GPS to find the shortest path between two points, rather than driving around randomly and hoping to reach the destination.
Paper Information
Categories:
cs.LG
Published Date:

arXiv ID:

2509.22592v1

Quick Actions