✨Accelerating Streaming Video Large Language Models via Hierarchical Token Compression
📝 Summary:
Streaming VideoLLMs face high latency from ViT encoding and LLM pre-filling. STC, a hierarchical framework, optimizes this by caching features and pruning tokens. It reduces latency by up to 24.5 percent for ViT and 45.3 percent for LLM pre-filling, retaining 99 percent accuracy.
🔹 Publication Date: Published on Nov 30
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2512.00891
• PDF: https://arxiv.org/pdf/2512.00891
• Github: https://github.com/lern-to-write/STC
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#VideoLLM #LLM #DeepLearning #AI #PerformanceOptimization
📝 Summary:
Streaming VideoLLMs face high latency from ViT encoding and LLM pre-filling. STC, a hierarchical framework, optimizes this by caching features and pruning tokens. It reduces latency by up to 24.5 percent for ViT and 45.3 percent for LLM pre-filling, retaining 99 percent accuracy.
🔹 Publication Date: Published on Nov 30
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2512.00891
• PDF: https://arxiv.org/pdf/2512.00891
• Github: https://github.com/lern-to-write/STC
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#VideoLLM #LLM #DeepLearning #AI #PerformanceOptimization
✨AURA: Always-On Understanding and Real-Time Assistance via Video Streams
📝 Summary:
AURA is an end-to-end streaming visual interaction framework for continuous video understanding. It enables real-time question answering and proactive responses, improving on current VideoLLMs through integrated context management and optimized deployment.
🔹 Publication Date: Published on Apr 5
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.04184
• PDF: https://arxiv.org/pdf/2604.04184
• Project Page: https://aurateam2026.github.io
• Github: https://github.com/aurateam2026/AURA
🔹 Models citing this paper:
• https://huggingface.co/aurateam/AURA
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#VideoUnderstanding #RealTimeAI #VideoLLM #ComputerVision #DeepLearning
📝 Summary:
AURA is an end-to-end streaming visual interaction framework for continuous video understanding. It enables real-time question answering and proactive responses, improving on current VideoLLMs through integrated context management and optimized deployment.
🔹 Publication Date: Published on Apr 5
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.04184
• PDF: https://arxiv.org/pdf/2604.04184
• Project Page: https://aurateam2026.github.io
• Github: https://github.com/aurateam2026/AURA
🔹 Models citing this paper:
• https://huggingface.co/aurateam/AURA
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#VideoUnderstanding #RealTimeAI #VideoLLM #ComputerVision #DeepLearning