Earned autonomy
Each change type has a level. It is earned from production evidence and lost the moment a prediction breaks.
| Type | Level now | Granted / eligible | Reliability (lower bound) | Calibration (n settled) | Hands-off shipped | Change failure rate |
|---|---|---|---|---|---|---|
| docs | hands_off | hands_off / hands_off | 0.847 (17 ok, 0 failed) | Brier 0.003, overconfidence -0.050 (n = 17) | 9 | 0% |
| At its ceiling. | ||||||
| deps | assisted | assisted / assisted | 0.050 (0 ok, 0 failed) | Brier n/a, overconfidence n/a (n = 0) | 0 | n/a |
| 4 more clean changes to earn supervised (Brier bar not met). | ||||||
| feature | hands_off | hands_off / hands_off | 0.774 (17 ok, 1 failed) | Brier 0.053, overconfidence -0.133 (n = 36) | 0 | 6% |
| At its ceiling. | ||||||
| config | assisted | assisted / assisted | 0.224 (1 ok, 0 failed) | Brier n/a, overconfidence n/a (n = 0) | 0 | 0% |
| Locked at assisted by policy. | ||||||
Drills
Game-day drills run on the internal type below. They never touch a real change type.
| Type | Level now | Changes |
|---|---|---|
| drill | assisted | 1 |
Baselines on the stable revision
| Route | p50 ms | p95 ms | Error rate | Revision |
|---|---|---|---|---|
| /books/{id} | 11.46 | 13.74 | 0.0 | shelf-00168-mek |
| /health | 10.57 | 12.68 | 0.0 | shelf-00168-mek |
| /lists | 30.15 | 43.99 | 0.0 | shelf-00168-mek |
| /lists/{id} | 19.94 | 29.74 | 0.0 | shelf-00168-mek |
| /search | 12.92 | 15.66 | 0.0 | shelf-00168-mek |