💡 The Qwen Image VAE 2.0 technical report presents a high compression Variational Autoencoder suite that improves reconstruction fidelity and diffusability. The problem addressed in this paper is the reconstruction bottleneck of high compression in Variational Autoencoders. To solve this problem, the authors propose an improved architecture featuring Global Skip Connections and expanded latent channels. They also scale training to billions of images and incorporate a synthetic rendering engine to improve performance in text rich scenarios.

The method used in this paper involves implementing an enhanced semantic alignment strategy to make the latent space highly amenable to diffusion modeling. The authors also leverage an asymmetric and attention free encoder decoder backbone to minimize encoding overhead. The performance of Qwen Image VAE 2.0 is evaluated on public reconstruction benchmarks and a new benchmark called OmniDoc TokenBench, which is a collection of real world documents with specialized OCR based evaluation metrics.

The results show that Qwen Image VAE 2.0 achieves state of the art reconstruction performance, demonstrating exceptional capabilities in both general domains and text rich scenarios at high compression ratio. Downstream DiT experiments reveal that the models possess superior diffusability, significantly accelerating convergence compared to existing high compression baselines. Overall, Qwen Image VAE 2.0 establishes itself as a leading model with high compression, superior reconstruction, and exceptional diffusability.

💡 The paper addresses the issue of modality sensitivity in vision-language models, which occurs when a model's performance degrades significantly when the modality of the input is changed, such as replacing a textual question with its rendered-image counterpart. This problem arises due to the inherent bias in current training corpora, where text and images are typically organized into distinct and asymmetric roles. To address this issue, the authors propose Local Modality Substitution, a data curation approach that provides supervision for cross-modal representational invariance between semantically equivalent text and image carriers. This method reformulates single-modality prompts into seamlessly interleaved multimodal sequences by dynamically selecting target text spans and recasting them as rendered images, thereby preserving the same semantics across different carriers. The authors evaluate their approach on 13 diverse multimodal benchmarks and demonstrate that it significantly improves overall multimodal reasoning and yields deeper cross-modal fusion, achieving consistent gains across foundational models. Specifically, the approach delivers improvements of 2.67 points on one model and 2.82 points on another, compared to standard methods. The proposed method is lightweight and architecture-agnostic, making it a valuable contribution to the field of vision-language models.