# Absolute Zero (machine learning)
Absolute Zero is a reinforced self-play paradigm for training language-model reasoning in which a single model proposes its own tasks and learns to solve them, with no external task data, using a program executor as the only external verifier. It was introduced in a paper released on arXiv in May 2025 (arXiv 2505.03335) and published at NeurIPS 2025, together with an implementation called the Absolute Zero Reasoner (AZR).[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf)
The paradigm takes its name and its inspiration from AlphaZero-style self-play, in which a system improves purely through self-interaction rather than human supervision. The authors state that, similar to [AlphaZero](https://www.edgepedia.org/alphazero), their paradigm "requires no human supervision and learns entirely through self-interaction," but applied to language-model reasoning rather than board games.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) They position it as a step toward an "era of experience" in which reasoning models are trained on self-generated, environment-verified tasks.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf)
| Key fact | Detail |
|---|---|
| What it is | A self-play training paradigm: one model proposes and solves its own verifiable tasks with zero external task data[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| System | Absolute Zero Reasoner (AZR), trained end-to-end with a new reinforcement learning advantage estimator[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| Verifier | A Python code executor validates proposed tasks and grades solutions[3](https://github.com/LeapLabTHU/Absolute-Zero-Reasoner) |
| Task types | Induction, abduction, and deduction over program/input/output triplets[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| Headline result | AZR-Coder-7B beat prior zero-setting models by an average of 1.8 absolute points on coding and math (vendor-reported)[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| Base models | Qwen2.5-7B, Qwen2.5-7B-Coder, plus 3B, 14B, and Llama-3.1-8B variants[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| Safety signal | The paper reports a "uh-oh moment": worrying behavior observed with Llama3.1-8B[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) |
| Status of evidence | All benchmark numbers are vendor-reported; no independent reproduction appears in the kept sources[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) • [2](https://andrewzh112.github.io/absolute-zero-reasoner/) |
## How it works
AZR trains one model in two roles. As a proposer, the model generates tasks; as a solver, it produces answers to them. An external environment, a code executor, validates each proposed task into an (x, y★) pair and returns two rewards: a learnability reward for the proposer and a solution reward for the solver. The learnability reward is the mechanism by which the model learns to define tasks that maximize learnability, so that self-generated tasks remain worth solving as the model evolves.[2](https://andrewzh112.github.io/absolute-zero-reasoner/)
Tasks are framed as reasoning about one element of a program, input, or output triplet, corresponding to three reasoning modes: deduction (predict the output given program and input), abduction (infer a plausible input given program and output), and induction (write a program consistent with input-output examples).[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) The official implementation runs an iterative PROPOSE/SOLVE loop: the model generates tasks of the three types, tasks are validated by Python execution with a learnability reward, the model then solves them with execution-verified accuracy rewards, and both phases are improved with TRR++, a reinforcement learning advantage estimator introduced with the paper, in a self-evolving loop that the repository describes as requiring no external training data.[3](https://github.com/LeapLabTHU/Absolute-Zero-Reasoner)
Main experiments trained AZR on Qwen2.5-7B and Qwen2.5-7B-Coder, with additional runs on Qwen2.5-Coder-3B, Qwen2.5-Coder-14B, Qwen2.5-14B, and Llama-3.1-8B, using batch size 64×6, learning rate 1e-6, and AdamW.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) The repository's stated self-play compute requirements are 2×80GB GPUs for 3B models and 8×80GB for 14B models; its text gives conflicting figures of 8×80GB and 4×80GB for 7/8B models, an unresolved discrepancy in the project's own documentation.[3](https://github.com/LeapLabTHU/Absolute-Zero-Reasoner)
## Origins and lineage
The name maps onto AlphaZero only by analogy. AlphaZero improves through self-play; Absolute Zero applies the same no-human-supervision principle to open-ended language reasoning, where the "rules" are supplied by a code executor rather than a game engine.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf)
The official code is hosted in the LeapLabTHU GitHub organization's repository.[3](https://github.com/LeapLabTHU/Absolute-Zero-Reasoner)
## Measured results
All benchmark numbers below are vendor-reported, from the paper and the authors' project page; the kept sources contain no independent reproduction.
AZR-Coder-7B, trained with no in-distribution data, outperformed previous models trained in the "zero" setting by an average of 1.8 absolute points across coding and math, and beat models trained with expert-curated human data in coding by 0.3 absolute points.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) On Qwen2.5-Coder bases, the authors report total out-of-distribution averages rising from 35.0 to 40.7 for the 3B model (+5.7), 40.2 to 50.4 for the 7B (+10.2), and 40.1 to 53.3 for the 14B (+13.2). For the 7B coder, the code average rose from 56.6 to 61.6 and math from 23.9 to 39.1; for the 14B coder, math rose from 20.2 to 43.0 (+22.8).[2](https://andrewzh112.github.io/absolute-zero-reasoner/)
Evaluation used out-of-distribution coding benchmarks ([HumanEval](https://www.edgepedia.org/humaneval)+, MBPP+, and LiveCodeBench Generation v1-5, covering May 23 to February 25) and six math benchmarks (AIME'24, AIME'25, OlympiadBench, Minerva, Math500, AMC'23), with greedy decoding for reproducibility.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf)
The authors also report a cross-domain comparison with RLVR: after RLVR training, expert code models gained on average only 0.65% in math, while AZR base and coder variants gained 10.9% and 15.2% respectively, which they present as stronger cross-domain generalization.[1](https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf) Gains scale with model size in their runs: the 3B model plateaued beyond 200 training steps while the 7B and 14B models kept improving, which the authors read as scaling enhancing the paradigm's effectiveness; they state that scaling laws for the paradigm are future work.[2](https://andrewzh112.github.io/absolute-zero-reasoner/)
## References
1. Absolute Zero: Reinforced Self-play Reasoning with Zero Data (NeurIPS 2025 paper). https://papers.nips.cc/paper_files/paper/2025/file/9837dc00ff67d176373268ed48042d49-Paper-Conference.pdf
2. Absolute Zero Reasoner — authors' project page. https://andrewzh112.github.io/absolute-zero-reasoner/
3. LeapLabTHU/Absolute-Zero-Reasoner (official code repository). https://github.com/LeapLabTHU/Absolute-Zero-Reasoner
---
*Topic: Encyclopedia › Technology and the built world › Computing and digital systems › Modern AI: foundation models, generative AI, and the AI industry › Foundation-model methods and training › Post-training and alignment methods*
*Initially written Sep 17, 2026 · Edited: Oct 11, 2026; Oct 15, 2026*
*Copyright 2026 EdgeChat AI, a subsidiary of Biostate AI.*
License: Edgepedia Community License 1.0, https://www.edgepedia.org/edgepedia/license