OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	remove-root-key	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-5.00, 0.00] Games: 17800 W: 4533 L: 4493 D: 8774 Ptnml(0-2): 127, 2015, 4596, 2015, 147
World	Peregrine	non-func-cleanups	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 7872 W: 2057 L: 1982 D: 3833 Ptnml(0-2): 44, 829, 2119, 896, 48
World	Peregrine	remove-squarebb	diff	10.0+0.10	LLR: 2.89 (-2.25, 2.89) [-5.00, 0.00] Games: 12058 W: 3097 L: 3038 D: 5923 Ptnml(0-2): 75, 1284, 3245, 1357, 68
World	Peregrine	simplify-countermove	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 11388 W: 2932 L: 2864 D: 5592 Ptnml(0-2): 94, 1407, 2630, 1463, 100
Peregr	Peregrine	rmOldAlpha	diff	10.0+0.10	LLR: 2.97 (-2.25, 2.89) [-3.00, 1.00] Games: 49322 W: 12585 L: 12520 D: 24217 Ptnml(0-2): 437, 5978, 11755, 6065, 426
Peregr	Peregrine	smallDoMove	diff	10.0+0.10	LLR: -1.47 (-2.25, 2.89) [-3.00, 1.00] Games: 3872 W: 947 L: 1018 D: 1907 Ptnml(0-2): 32, 426, 1080, 377, 21
Peregr	Peregrine	rmCompletedDepth	diff	10.0+0.10	LLR: -0.31 (-2.25, 2.89) [-3.00, 1.00] Games: 2460 W: 651 L: 669 D: 1140 Ptnml(0-2): 21, 267, 672, 249, 21
Peregr	Peregrine	rmCompletedDepth2	diff	10.0+0.10	LLR: -0.19 (-2.25, 2.89) [-3.00, 1.00] Games: 136 W: 30 L: 39 D: 67 Ptnml(0-2): 2, 18, 35, 13, 0
Peregr	Peregrine	CJmissingPrefetch	diff	10.0+0.10	LLR: -0.83 (-2.25, 2.89) [0.00, 3.00] Games: 45060 W: 11458 L: 11407 D: 22195 Ptnml(0-2): 275, 4935, 12084, 4936, 300
Peregr	Peregrine	SimplImproving	diff	10.0+0.10	LLR: -2.27 (-2.25, 2.89) [-3.00, 1.00] Games: 20248 W: 5130 L: 5272 D: 9846 Ptnml(0-2): 187, 2474, 4926, 2368, 169
World	Peregrine	lmr-simplification-3	diff	10.0+0.10	LLR: -1.50 (-2.25, 2.89) [-3.00, 1.00] Games: 52950 W: 13347 L: 13505 D: 26098 Ptnml(0-2): 474, 6502, 12630, 6446, 423
World	Peregrine	tm-spsa2	diff	10.0+0.10	Tuning 24 Parameters 2850/5000 Iterations 45600/80000 Games Played
Peregr	Peregrine	searchfunctionSmall	diff	10.0+0.10	Elo: -9.53 +- 3.89 (95%) [N=40000] Games: 8644 W: 2052 L: 2289 D: 4303 Ptnml(0-2): 75, 1069, 2242, 890, 46
Peregr	Peregrine	rmAdvancedPawn	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-3.00, 1.00] Games: 20302 W: 5105 L: 4997 D: 10200 Ptnml(0-2): 164, 2398, 4916, 2512, 161
World	Peregrine	history-update	diff	10.0+0.10	LLR: -0.75 (-2.25, 2.89) [0.00, 3.00] Games: 4490 W: 1106 L: 1143 D: 2241 Ptnml(0-2): 42, 551, 1082, 542, 28
World	Peregrine	expt-04-batch-size-25000-run-01	diff	10.0+0.10	LLR: -1.46 (-2.25, 2.89) [0.00, 3.00] Games: 5928 W: 1608 L: 1694 D: 2626 Ptnml(0-2): 75, 801, 1299, 713, 76
World	Peregrine	qs-pruning	diff	10.0+0.10	LLR: -0.31 (-2.25, 2.89) [0.00, 3.00] Games: 49664 W: 12618 L: 12519 D: 24527 Ptnml(0-2): 399, 6017, 11891, 6136, 389
Peregr	Peregrine	tm-spsa2-44k	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 14876 W: 3806 L: 3592 D: 7478 Ptnml(0-2): 88, 1650, 3771, 1818, 111
World	Peregrine	expt-01-halved-target-run-02	diff	10.0+0.10	LLR: -1.71 (-2.25, 2.89) [0.00, 3.00] Games: 6586 W: 1736 L: 1834 D: 3016 Ptnml(0-2): 75, 849, 1535, 767, 67
World	Peregrine	expt-01-halved-target-run-01	diff	N=25000	Elo: 0.83 +- 3.00 (95%) [N=40000] Games: 30024 W: 10796 L: 10724 D: 8504 Ptnml(0-2): 1412, 3046, 6043, 3080, 1431
World	Peregrine	expt-01-halved-target-run-01	diff	10.0+0.10	Elo: -2.43 +- 3.11 (95%) [N=40000] Games: 17144 W: 4658 L: 4778 D: 7708 Ptnml(0-2): 254, 2126, 3906, 2058, 228
Peregr	Peregrine	cutNodeInCapture	diff	10.0+0.10	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 84116 W: 20684 L: 20633 D: 42799 Ptnml(0-2): 569, 10194, 20472, 10263, 560
World	Peregrine	lmr-complexity	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 27726 W: 6978 L: 7057 D: 13691 Ptnml(0-2): 221, 3428, 6646, 3345, 223
World	Peregrine	ordering-weights	diff	10.0+0.10	LLR: -0.80 (-2.25, 2.89) [0.00, 3.00] Games: 1484 W: 345 L: 393 D: 746 Ptnml(0-2): 20, 184, 372, 156, 10
Peregr	Peregrine	qsStagesThing	diff	10.0+0.10	LLR: -0.84 (-2.25, 2.89) [-3.00, 1.00] Games: 726 W: 152 L: 194 D: 380 Ptnml(0-2): 11, 98, 180, 70, 4

1 2 3 97 98 99 100 101 135 136 137