💡 The paper introduces OSP-Next, an efficient text-to-video generation model that addresses the high computational costs of existing models. The problem with current models, such as Diffusion Transformers, is that they achieve strong video generation quality but have quadratic costs due to full attention. To solve this, OSP-Next combines sparse attention, parallelism, quantization, and reinforcement learning.

The method used in OSP-Next is a hybrid full-sparse attention architecture, where the sparse component is implemented with Skiparse-2D Attention. This mechanism applies token-wise and group-wise sparse attention along spatial dimensions, leveraging locality while maintaining compatibility with FlashAttention kernels. The authors also propose Sparse Sequence Parallelism, which partitions subsequences across ranks and switches sparse patterns through a single All-to-All communication. This approach reduces communication volume by 75% compared to Ulysses Sequence Parallelism.

Additionally, OSP-Next incorporates HiF8 quantization to enable stable joint training with 8-bit quantization and sparse fine-tuning. The model also applies Mix-GRPO post-training to improve the performance of the sparse model. The authors evaluate OSP-Next on various settings, including 5-second 720P and 5-second 768P, and achieve significant speedups on NVIDIA H200 GPUs and Ascend 950PR hardware.

The results show that OSP-Next achieves a VBench total score of 83.73%, surpassing the Wan2.1 baseline. The model achieves up to 1.64 times single-GPU speedup and over 1.52 times eight-GPU speedup on NVIDIA H200 GPUs. Furthermore, with only a 0.4% drop in VBench total score, OSP-Next-HiF8 achieves 1.69 times and 2.27 times speedups under the two settings on a single Ascend 950PR, demonstrating the efficiency and performance of OSP-Next across hardware platforms. Overall, the paper contributes to the development of efficient text-to-video generation models with high-quality video synthesis and reduced computational costs.