💡 The paper introduces Asymmetric Flow Modeling, a method for efficient high-dimensional flow-based generation. The problem with existing flow-based generation methods is that they require modeling high-dimensional noise, which is difficult even when the data has a strong low-rank structure. To address this, the authors propose a rank-asymmetric velocity parameterization that restricts noise prediction to a low-rank subspace while keeping data prediction full-dimensional. This approach allows for the analytical recovery of the full-dimensional velocity without changing the network architecture or training procedures.

The method, called AsymFlow, enables effective fine-tuning from latent models to pixel-space models by aligning the low-rank pixel subspace to the latent space. This provides a seamless initialization that preserves the latent model's high-level semantics and structure, allowing fine-tuning to mainly improve low-level mismatches rather than relearning pixel generation.

The results show that AsymFlow achieves a leading performance on ImageNet 256x256, outperforming prior pixel diffusion models by a large margin. Additionally, the authors demonstrate that AsymFlow provides a route for fine-tuning pretrained latent flow models into pixel-space models, establishing a new state of the art for pixel-space text-to-image generation. The pixel AsymFlow model fine-tuned from a latent base model achieves better performance on several benchmarks, including HPSv3, DPG-Bench, and GenEval, and shows substantially improved visual realism. Overall, the paper presents a significant contribution to the field of flow-based generation, enabling efficient and effective high-dimensional generation and fine-tuning of latent models.