💡 The paper proposes a self-improving AI framework called SIA that addresses the bottleneck of human involvement in building and improving AI systems. Currently, two separate research approaches exist to tackle this issue: the harness-update school, which updates the task-specific agent's architecture while keeping the model weights fixed, and the test-time training school, which updates the model weights using reinforcement learning pipelines while keeping the harness fixed. However, these two approaches operate in isolation.

The SIA framework combines these two approaches by introducing a language-model feedback agent that simultaneously updates both the model weights and the task-specific agent's architecture. This is achieved through a self-improving loop where the feedback agent provides updates to both the harness and the weights of the task-specific agent.

The authors evaluate the SIA framework across three diverse domains: Chinese legal charge classification, low-level GPU kernel optimization, and single-cell RNA denoising. The results show that combining both harness and weight updates outperforms using only harness updates. The gains are significant, with improvements of 56.6% on the LawBench benchmark, 91.9% runtime reduction on GPU kernels, and 502% improvement on denoising over the initial baseline.

The SIA framework makes the model more agentic by shaping how it searches and acts, while the weight updates build domain-specific intuition that cannot be instilled through prompts or scaffolds alone. Overall, the paper contributes to the development of self-improving AI systems by proposing a novel framework that integrates both harness and weight updates, demonstrating its effectiveness across multiple domains.