🔥 Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering

💡 The paper introduces Frontis-MA1, a model that achieves recursive self-improvement in machine learning engineering. Recursive self-improvement requires AI systems to improve the process of building AI, and machine learning engineering offers a concrete test bed for studying this capability. The authors propose OpenMLE, an open full-stack system for recursive self-improvement research in machine learning engineering, which includes a verifiable task environment with execution feedback, operator learning, and long-horizon search.

The Frontis-MA1 model is trained as a meta-evolution agent for machine learning engineering, aligning post-training and inference around four atomic program-evolution operators: Draft, Improve, Debug, and Crossover. These operators are trained via execution-grounded self-supervised training and reinforcement learning on data duplicated against all evaluation benchmarks, then composed into long-horizon search, coupling learning and evolution in a single loop.

The results show that Frontis-MA1 improves the Medal Average from 39.39% to 60.61% over its base model with OpenMLE-Evo, and reaches 71.21% with OpenMLE-Evo-Max, exceeding GPT-5.5+Codex and approaching GPT-5.6 Soland and the 2.8T Kimi K3. On the held-out Nature Bench Lite, both components transfer: with the framework fixed, swapping in the trained model raises Match-SOTA from 50% to 70%, and with the model fixed, swapping in OpenMLE-Evo raises it from 20% to 50%.

The authors release the model weights and the full OpenMLE stack to enable reproducible research on executable AI4AI towards recursive self-improvement. The paper demonstrates the effectiveness of Frontis-MA1 and OpenMLE in achieving recursive self-improvement in machine learning engineering, and provides a foundation for further research in this area.

📅 Published on Jul 30

🔗 Links:
• GitHub: https://github.com/huggingface
• arXiv: https://arxiv.org/abs/2607.28568
• PDF: https://arxiv.org/pdf/2607.28568
• Project Page: https://frontisai.github.io/OpenRSI/

🤖 Models citing this paper:
• https://huggingface.co/FrontisAI/Frontis-MA1-35B-GGUF
• https://huggingface.co/FrontisAI/Frontis-MA1-30B
• https://huggingface.co/FrontisAI/Frontis-MA1-30B-GGUF

📊 Datasets citing this paper:
• https://huggingface.co/datasets/FrontisAI/OpenMLE-Tasks
• https://huggingface.co/datasets/FrontisAI/OpenMLE-SFT-Traces

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://t.iss.one/PaperNexus

#MachineLearningEngineering #ArtificialIntelligenceForAI #RecursiveSelfImprovement #MetaLearningAlgorithms #AIModelTraining