History Heuristic AB Test¶
Status: complete
Engine¶
| Metric | Value |
|---|---|
| Baseline | dev c7adea72d0867ff865d41ead4dc3b084aca82c37 |
| Candidate | feature/history-heuristic 31f1cc4490802d66e59063a5734e0275284bedf0 |
Result¶
| Metric | Value |
|---|---|
| Games | 500 |
| Candidate wins | 200 |
| Candidate losses | 127 |
| Draws | 173 |
| Unknown | 0 |
| Score rate | 0.573 |
| Draw rate | 0.346 |
| Elo diff | +51.1 |
| Error 95% | ±24.8 |
| Elo range 95% | +26.3 ~ +75.8 |
| LOS | 100.0% |
SPRT¶
| Metric | Value |
|---|---|
| Elo0 | +0.0 |
| Elo1 | +10.0 |
| Alpha | 0.050 |
| Beta | 0.050 |
| LLR | +2.993 |
| Lower bound | -2.944 |
| Upper bound | +2.944 |
| Result | PASS |
Batch status¶
| Metric | Value |
|---|---|
| Batches found | 25 |
| Start batch | 0 |
| Expected batches | 25 |
| Missing batches | None |
| Failed batches | None |
| Duplicate batches | None |