OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	cleanups-11	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [-5.00, 0.00] Games: 52202 W: 12946 L: 13035 D: 26221 Ptnml(0-2): 306, 5635, 14299, 5564, 297
World	Peregrine	expt-05-64-hl-run-01	diff	10.0+0.10	LLR: -1.91 (-2.25, 2.89) [0.00, 3.00] Games: 9652 W: 2571 L: 2676 D: 4405 Ptnml(0-2): 119, 1230, 2228, 1135, 114
World	Peregrine	spsa6	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 21496 W: 5450 L: 5212 D: 10834 Ptnml(0-2): 145, 2544, 5163, 2720, 176
World	Peregrine	spsa6	diff	10.0+0.10	Tuning 109 Parameters 7500/7500 Iterations 120004/120000 Games Played
World	Peregrine	one-killer	diff	10.0+0.10	LLR: -1.48 (-2.25, 2.89) [-3.00, 0.00] Games: 32684 W: 8072 L: 8246 D: 16366 Ptnml(0-2): 278, 4044, 7883, 3848, 289
World	Peregrine	simplify-irreversible-ext	diff	10.0+0.10	LLR: -2.28 (-2.25, 2.89) [-3.00, 0.00] Games: 28122 W: 6862 L: 7063 D: 14197 Ptnml(0-2): 179, 3201, 7501, 3002, 178
World	Peregrine	history-limits-test	diff	10.0+0.10	Elo: -4.87 +- 5.49 (95%) [N=40000] Games: 4640 W: 1104 L: 1169 D: 2367 Ptnml(0-2): 33, 603, 1110, 544, 30
World	Peregrine	simplify-improving-condition	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [-3.00, 0.00] Games: 43408 W: 10733 L: 10980 D: 21695 Ptnml(0-2): 327, 5421, 10442, 5200, 314
World	Peregrine	clang-flags	diff	10.0+0.10	LLR: 2.89 (-2.25, 2.89) [-5.00, 0.00] Games: 20956 W: 5309 L: 5283 D: 10364 Ptnml(0-2): 128, 2278, 5634, 2316, 122
World	Peregrine	cleanups-10	diff	10.0+0.10	LLR: -0.08 (-2.25, 2.89) [-5.00, 0.00] Games: 2428 W: 610 L: 622 D: 1196 Ptnml(0-2): 14, 280, 641, 262, 17
World	Peregrine	cleanups-9	diff	10.0+0.10	LLR: 2.95 (-2.25, 2.89) [-5.00, 0.00] Games: 46944 W: 11765 L: 11834 D: 23345 Ptnml(0-2): 302, 5151, 12617, 5118, 284
World	Peregrine	remove-draw-edge-case	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-5.00, 0.00] Games: 28984 W: 7258 L: 7261 D: 14465 Ptnml(0-2): 179, 3221, 7717, 3174, 201
World	Peregrine	sf-pseudo-legal	diff	10.0+0.10	LLR: -1.44 (-2.25, 2.89) [-5.00, 0.00] Games: 3596 W: 862 L: 925 D: 1809 Ptnml(0-2): 21, 402, 1011, 347, 17
World	Peregrine	remove-piece-lists	diff	10.0+0.10	LLR: 2.95 (-2.25, 2.89) [-5.00, 0.00] Games: 61354 W: 15374 L: 15498 D: 30482 Ptnml(0-2): 409, 6898, 16174, 6800, 396
World	Peregrine	remove-root-key	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-5.00, 0.00] Games: 17800 W: 4533 L: 4493 D: 8774 Ptnml(0-2): 127, 2015, 4596, 2015, 147
World	Peregrine	non-func-cleanups	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 7872 W: 2057 L: 1982 D: 3833 Ptnml(0-2): 44, 829, 2119, 896, 48
World	Peregrine	remove-squarebb	diff	10.0+0.10	LLR: 2.89 (-2.25, 2.89) [-5.00, 0.00] Games: 12058 W: 3097 L: 3038 D: 5923 Ptnml(0-2): 75, 1284, 3245, 1357, 68
World	Peregrine	simplify-countermove	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 11388 W: 2932 L: 2864 D: 5592 Ptnml(0-2): 94, 1407, 2630, 1463, 100
World	Peregrine	lmr-simplification-3	diff	10.0+0.10	LLR: -1.50 (-2.25, 2.89) [-3.00, 1.00] Games: 52950 W: 13347 L: 13505 D: 26098 Ptnml(0-2): 474, 6502, 12630, 6446, 423
World	Peregrine	tm-spsa2	diff	10.0+0.10	Tuning 24 Parameters 2850/5000 Iterations 45600/80000 Games Played
World	Peregrine	history-update	diff	10.0+0.10	LLR: -0.75 (-2.25, 2.89) [0.00, 3.00] Games: 4490 W: 1106 L: 1143 D: 2241 Ptnml(0-2): 42, 551, 1082, 542, 28
World	Peregrine	expt-04-batch-size-25000-run-01	diff	10.0+0.10	LLR: -1.46 (-2.25, 2.89) [0.00, 3.00] Games: 5928 W: 1608 L: 1694 D: 2626 Ptnml(0-2): 75, 801, 1299, 713, 76
World	Peregrine	qs-pruning	diff	10.0+0.10	LLR: -0.31 (-2.25, 2.89) [0.00, 3.00] Games: 49664 W: 12618 L: 12519 D: 24527 Ptnml(0-2): 399, 6017, 11891, 6136, 389
World	Peregrine	expt-01-halved-target-run-02	diff	10.0+0.10	LLR: -1.71 (-2.25, 2.89) [0.00, 3.00] Games: 6586 W: 1736 L: 1834 D: 3016 Ptnml(0-2): 75, 849, 1535, 767, 67
World	Peregrine	expt-01-halved-target-run-01	diff	N=25000	Elo: 0.83 +- 3.00 (95%) [N=40000] Games: 30024 W: 10796 L: 10724 D: 8504 Ptnml(0-2): 1412, 3046, 6043, 3080, 1431

1 2 3 183 184 185 186 187 216 217 218