Teacher depth across training

Qwen3.8-27B · Enterprise Chat

Depth distribution, τ = 0.1

Steps 0–9Steps 10–19Steps 20–29Steps 30–39Steps 40–49Steps 50–62
Depth distribution, τ = 0.10%5%10%15%20%25%30%Share of policy tokens012345–89–1617–3233–6465–128129+Depth Dₜ (teacher tokens aligned from position t)

Share with Dₜ ≥ 9

τ = 0.01τ = 0.03τ = 0.1τ = 0.3
Share with Dₜ ≥ 90%20%40%60%80%100%Share with Dₜ ≥ 90–910–1920–2930–3940–4950–62Training steps