✨Steerable Visual Representations

📝 Summary:
Steerable Visual Representations allow language-guided focus on specific image elements while maintaining high representation quality. This is achieved through early fusion of text directly into the visual encoder. Our method outperforms dedicated approaches and generalizes well to new tasks.

🔹 Publication Date: Published on Apr 2

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.02327
• PDF: https://arxiv.org/pdf/2604.02327
• Project Page: https://jonaruthardt.github.io/project/SteerViT/
• Github: https://github.com/JonaRuthardt/SteerViT

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#ComputerVision #DeepLearning #MultimodalAI #ImageRecognition #AI

✨Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?

📝 Summary:
Agentic-MME introduces a process-verified benchmark for multimodal agentic capabilities. It evaluates tool usage and efficiency using real-world tasks and stepwise checkpoints, revealing models struggle with complex multimodal problem-solving.

🔹 Publication Date: Published on Apr 3

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.03016
• PDF: https://arxiv.org/pdf/2604.03016
• Project Page: https://agenticmme.github.io/

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#AgenticAI #MultimodalAI #AIEvaluation #AIResearch #Benchmarks

✨CoME-VL: Scaling Complementary Multi-Encoder Vision-Language Learning

📝 Summary:
CoME-VL fuses contrastive and self-supervised vision encoders to improve vision-language models. It uses entropy-guided aggregation and RoPE-enhanced attention for better visual understanding and grounding, outperforming single-encoder baselines.

🔹 Publication Date: Published on Apr 3

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.03231
• PDF: https://arxiv.org/pdf/2604.03231
• Project Page: https://mbzuai-oryx.github.io/CoME-VL/
• Github: https://github.com/mbzuai-oryx/CoME-VL

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#VisionLanguage #MultimodalAI #ComputerVision #MachineLearning #DeepLearning

✨PLUME: Latent Reasoning Based Universal Multimodal Embedding

📝 Summary:
PLUME introduces a latent reasoning framework for universal multimodal embedding that replaces explicit chain-of-thought reasoning with continuous latent state rollouts, achieving faster inference whi...

🔹 Publication Date: Published on Apr 2

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.02073
• PDF: https://arxiv.org/pdf/2604.02073
• Project Page: https://haoxiangzhao12138.github.io/PLUME/
• Github: https://github.com/haoxiangzhao12138/PLUME

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#MultimodalAI #LatentReasoning #Embeddings #AIResearch #MachineLearning

✨BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs

📝 Summary:
BidirLM adapts causal LLMs into bidirectional encoders, overcoming catastrophic forgetting and integrating specialized models. It employs a prior masking phase, weight merging, and data mixture, outperforming alternatives on text, vision, and audio benchmarks.

🔹 Publication Date: Published on Apr 2

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.02045
• PDF: https://arxiv.org/pdf/2604.02045

🔹 Models citing this paper:
• https://huggingface.co/BidirLM/BidirLM-Omni-2.5B-Embedding
• https://huggingface.co/BidirLM/BidirLM-0.6B-Embedding
• https://huggingface.co/BidirLM/BidirLM-1.7B-Embedding

✨ Datasets citing this paper:
• https://huggingface.co/datasets/BidirLM/BidirLM-Contrastive

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#LLM #MultimodalAI #DeepLearning #AIResearch #ModelAdaptation

✨EXAONE 4.5 Technical Report

📝 Summary:
EXAONE 4.5 is LG AI Research's first open-weight vision language model, integrating a visual encoder into EXAONE 4.0. It enhances document understanding and general language capabilities through targeted data and extended context, outperforming similar models in document tasks.

🔹 Publication Date: Published on Apr 9

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.08644
• PDF: https://arxiv.org/pdf/2604.08644
• Github: https://github.com/LG-AI-EXAONE/EXAONE-4.5

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#VisionLanguageModel #AI #DocumentUnderstanding #MultimodalAI #OpenSourceAI

✨FORGE:Fine-grained Multimodal Evaluation for Manufacturing Scenarios

📝 Summary:
FORGE introduces a multimodal manufacturing dataset, revealing that MLLM performance is limited by domain-specific knowledge, not visual grounding. Fine-tuning on FORGEs annotations significantly improves accuracy, offering a path for domain-adapted MLLMs.

🔹 Publication Date: Published on Apr 8

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.07413
• PDF: https://arxiv.org/pdf/2604.07413
• Project Page: https://ai4manufacturing.github.io/forge-web/
• Github: https://github.com/AI4Manufacturing/FORGE

✨ Datasets citing this paper:
• https://huggingface.co/datasets/AI4Manufacturing/forge

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#FORGE #MLLM #ManufacturingAI #MultimodalAI #DomainAdaptation

✨PersonaVLM: Long-Term Personalized Multimodal LLMs

📝 Summary:
PersonaVLM introduces a framework for long-term personalized multimodal LLMs. It remembers interactions, reasons multi-turn using retrieved memories, and aligns responses with evolving user personality. This novel method significantly outperforms baselines and GPT-4o on a new evaluation benchmark.

🔹 Publication Date: Published on Mar 20

🔹 Paper Links:
• arXiv Page: http://arxiv.org/abs/2604.13074
• PDF: https://arxiv.org/pdf/2604.13074
• Project Page: https://personavlm.github.io/
• Github: https://github.com/MiG-NJU/PersonaVLM

🔹 Models citing this paper:
• https://huggingface.co/ClareNie/PersonaVLM

✨ Datasets citing this paper:
• https://huggingface.co/datasets/ClareNie/Persona-MME
• https://huggingface.co/datasets/ClareNie/PersonaVLM-Dataset

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#LLM #MultimodalAI #PersonalizedAI #AIResearch #MemoryAI

✨Qwen3.5-Omni Technical Report

📝 Summary:
Qwen3.5-Omni is a large multimodal model excelling in audio-visual understanding and generation, achieving SOTA results across many benchmarks. It features a Hybrid Attention MoE architecture, introduces ARIA for improved speech synthesis, and exhibits a new Audio-Visual Vibe Coding capability.

🔹 Publication Date: Published on Apr 17

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.15804
• PDF: https://arxiv.org/pdf/2604.15804

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#MultimodalAI #AIResearch #DeepLearning #GenerativeAI #SpeechSynthesis

✨Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence

📝 Summary:
Nemotron 3 Nano Omni is a new efficient, open multimodal AI model. It natively supports audio, text, images, and video inputs, improving accuracy and efficiency over previous versions. It excels in document understanding and long audio-video comprehension.

🔹 Publication Date: Published on Apr 27

🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2604.24954
• PDF: https://arxiv.org/pdf/2604.24954

🔹 Models citing this paper:
• https://huggingface.co/nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16
• https://huggingface.co/nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4
• https://huggingface.co/nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8

✨ Spaces citing this paper:
• https://huggingface.co/spaces/akhaliq/Nemotron-3-Nano-Omni
• https://huggingface.co/spaces/developerjeremylive/Nemotron-3-Nano-Omni-etheroi

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#AI #MultimodalAI #DeepLearning #OpenSourceAI #AIResearch