💡 The paper addresses the challenges of training large scale high quality video foundation models that can generate high quality videos. Video foundation models have been used to simulate the real world and develop creative visual experiences but training them is difficult due to the complexity and size of video datasets. To overcome this the authors present a scalable open source pipeline using NVIDIA NeMo for training and inference of video foundation models. The pipeline provides accelerated video dataset curation multimodal data loading and parallelized video diffusion model training and inference. The authors also provide a comprehensive performance analysis highlighting best practices for efficient video foundation model training and inference. The pipeline is designed to address the challenges of training large scale video foundation models and provides a scalable and efficient solution for generating high quality videos. The results of the paper demonstrate the effectiveness of the pipeline in training video foundation models and provide insights into the best practices for efficient training and inference. Overall the paper contributes to the development of video foundation models by providing a scalable and efficient pipeline for training and inference.