✨End-to-End Test-Time Training for Long Context

📝 Summary:
This paper proposes End-to-End Test-Time Training TTT-E2E for long-context language modeling, treating it as continual learning. It uses a standard Transformer, learning at test time and improving initialization via meta-learning. TTT-E2E scales well and offers constant inference latency, being m...

🔹 Publication Date: Published on Dec 29, 2025

🔹 Paper Links:
• arXiv Page: https://arxivlens.com/PaperView/Details/end-to-end-test-time-training-for-long-context-6176-bf8fd7e6
• PDF: https://arxiv.org/pdf/2512.23675
• Github: https://github.com/test-time-training/e2e

==================================

For more data science resources:
✓ https://xn--r1a.website/DataScienceT

#TestTimeTraining #LongContext #LanguageModels #Transformers #ContinualLearning

🔥 SIA: Self Improving AI with Harness & Weight Updates

💡 The paper proposes a self-improving AI framework called SIA that addresses the bottleneck of human involvement in building and improving AI systems. Currently, two separate research approaches exist to tackle this issue: the harness-update school, which updates the task-specific agent's architecture while keeping the model weights fixed, and the test-time training school, which updates the model weights using reinforcement learning pipelines while keeping the harness fixed. However, these two approaches operate in isolation.

The SIA framework combines these two approaches by introducing a language-model feedback agent that simultaneously updates both the model weights and the task-specific agent's architecture. This is achieved through a self-improving loop where the feedback agent provides updates to both the harness and the weights of the task-specific agent.

The authors evaluate the SIA framework across three diverse domains: Chinese legal charge classification, low-level GPU kernel optimization, and single-cell RNA denoising. The results show that combining both harness and weight updates outperforms using only harness updates. The gains are significant, with improvements of 56.6% on the LawBench benchmark, 91.9% runtime reduction on GPU kernels, and 502% improvement on denoising over the initial baseline.

The SIA framework makes the model more agentic by shaping how it searches and acts, while the weight updates build domain-specific intuition that cannot be instilled through prompts or scaffolds alone. Overall, the paper contributes to the development of self-improving AI systems by proposing a novel framework that integrates both harness and weight updates, demonstrating its effectiveness across multiple domains.

📅 Published on May 26

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2605.27276
• PDF: https://arxiv.org/pdf/2605.27276
• Project Page: https://hexolabs.com/

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#SelfImprovingAI #HarnessUpdates #WeightUpdates #ReinforcementLearning #TestTimeTraining