Accumulated AB Test Summary¶
Status: complete
Engine¶
| Metric | Value |
|---|---|
| Baseline | dev 1af3fa2e84973bc02519009f6fa1e766db1e8ea4 |
| Candidate | bugfix/mate-in-two f539986d242fccacf7aff84ff47325b9b46653dc |
Result¶
| Metric | Value |
|---|---|
| Games | 700 |
| Candidate wins | 220 |
| Candidate losses | 229 |
| Draws | 251 |
| Unknown | 0 |
| Score rate | 0.494 |
| Draw rate | 0.359 |
| Elo diff | -4.5 |
| Error 95% | ±20.6 |
| Elo range 95% | -25.1 ~ +16.1 |
| LOS | 33.6% |
SPRT¶
| Metric | Value |
|---|---|
| Elo0 | +0.0 |
| Elo1 | +10.0 |
| Alpha | 0.050 |
| Beta | 0.050 |
| LLR | -0.856 |
| Lower bound | -2.944 |
| Upper bound | +2.944 |
| Result | CONTINUE |
Batch status¶
| Metric | Value |
|---|---|
| Batches found | 35 |
| Start batch | 0 |
| Expected batches | 35 |
| Missing batches | None |
| Failed batches | None |
| Duplicate batches | None |