💡 The paper introduces a new approach to language models called Multi-Stream LLMs, which aims to overcome the limitations of traditional language models that process information in a single stream of computation. The current models function on a message exchange format, where they successively exchange messages with users, systems, and tools, leading to limitations such as the inability to act while reading, react to new information while writing, think while reading or acting, and act while thinking.

To address these limitations, the authors propose a method that involves transitioning from sequential message-based instruction-tuning to parallel stream processing, enabling simultaneous reading and generation across multiple concurrent data flows. This is achieved by splitting each role into a separate stream, allowing the language model to simultaneously read from multiple input streams and generate tokens in multiple output streams, all of which causally depend on earlier timesteps.

The results of this approach show that it can improve model efficiency through parallelization, enhance model security through better separation of concerns, and increase model monitorability. The authors argue that this data-driven change can remedy the usability limitations of traditional language models, making them more efficient, secure, and transparent. Overall, the paper contributes to the development of more advanced language models that can process information in a more parallel and efficient manner, unlocking their potential for widespread use in various applications.