✨Harmony: Harmonizing Audio and Video Generation through Cross-Task Synergy

📝 Summary:
Harmony improves audio-visual synchronization in generative AI. It introduces a Cross-Task Synergy training paradigm, a Global-Local Decoupled Interaction Module, and Synchronization-Enhanced CFG. This significantly enhances generation fidelity and fine-grained audio-visual alignment, achieving s...

🔹 Publication Date: Published on Nov 26

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2511.21579
• PDF: https://arxiv.org/pdf/2511.21579
• Project Page: https://sjtuplayer.github.io/projects/Harmony/
• Github: https://github.com/sjtuplayer/Harmony

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#GenerativeAI #AudioVisual #DeepLearning #AISynchronization #AIResearch

✨ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA

📝 Summary:
ID-LoRA jointly generates visual appearance and voice with a single model, improving personalization. It uses in-context LoRA adaptation and identity guidance to preserve speaker characteristics. This outperforms existing methods in human preference for voice and style similarity.

🔹 Publication Date: Published on Mar 10

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.10256
• PDF: https://arxiv.org/pdf/2603.10256
• Project Page: https://id-lora.github.io/
• Github: https://github.com/ID-LoRA/ID-LoRA

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#GenerativeAI #AudioVisual #LoRA #Personalization #DeepLearning

✨OmniForcing: Unleashing Real-time Joint Audio-Visual Generation

📝 Summary:
OmniForcing transforms slow bidirectional audio-visual diffusion models into fast, real-time streaming generators. It tackles training instability and synchronization by using asymmetric alignment, a global prefix, and an audio sink token. This enables high-fidelity, synchronized generation at 25...

🔹 Publication Date: Published on Mar 12

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2603.11647
• PDF: https://arxiv.org/pdf/2603.11647
• Project Page: https://omniforcing.com/
• Github: https://github.com/OmniForcing/OmniForcing

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#GenerativeAI #AudioVisual #RealtimeAI #DiffusionModels #DeepLearning