💡 The paper introduces RoboMemArena, a comprehensive robotic memory benchmark that addresses the limitations of existing benchmarks by providing a large-scale and diverse set of tasks with real-world evaluation. The benchmark consists of 26 tasks with average trajectory lengths of over 1000 steps per task, and 68.9 percent of subtasks require memory dependence. The tasks are generated using a vision-language model that designs and composes subtasks, generates full trajectories, and provides memory-related annotations.

To tackle the challenges of the RoboMemArena benchmark, the authors propose PrediMem, a dual-system vision-language architecture that improves memory management through predictive coding. PrediMem consists of a high-level vision-language model planner that manages a memory bank with recent and keyframe buffers, and uses a predictive coding head to enhance sensitivity to task dynamics.

The authors evaluate PrediMem on the RoboMemArena benchmark and demonstrate that it outperforms all baseline models. The results provide insights into memory management, model architecture, and scaling laws for complex memory systems. The paper contributes to the development of robotic intelligence by providing a comprehensive benchmark and a state-of-the-art model that can effectively manage memory in partially observable environments.

The key contributions of the paper are the introduction of the RoboMemArena benchmark, which provides a challenging and diverse set of tasks for evaluating robotic memory, and the proposal of the PrediMem model, which demonstrates improved memory management through predictive coding. The paper also provides a thorough evaluation of the PrediMem model on the RoboMemArena benchmark, highlighting its effectiveness in managing memory in complex tasks. Overall, the paper advances the state-of-the-art in robotic memory and provides a foundation for future research in this area.