OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	conthist-shrink	diff	10.0+0.10	LLR: -2.29 (-2.25, 2.89) [-5.00, 0.00] Games: 20362 W: 4916 L: 5080 D: 10366 Ptnml(0-2): 125, 2513, 5064, 2359, 120
World	Peregrine	prior-countermove-sanity-check	diff	10.0+0.10	LLR: -0.64 (-2.25, 2.89) [0.00, 3.00] Games: 2056 W: 490 L: 525 D: 1041 Ptnml(0-2): 14, 262, 508, 233, 11
World	Peregrine	tt-size-768kb	diff	10.0+0.10	Elo: 0.57 +- 2.52 (95%) [N=40000] Games: 21158 W: 5189 L: 5154 D: 10815 Ptnml(0-2): 114, 2573, 5190, 2568, 134
World	Peregrine	small-speedup	diff	10.0+0.10	LLR: 0.60 (-2.25, 2.89) [0.00, 3.00] Games: 43010 W: 10550 L: 10414 D: 22046 Ptnml(0-2): 237, 5100, 10691, 5244, 233
World	Peregrine	expt-10-output-buckets	diff	10.0+0.10	LLR: -0.30 (-2.25, 2.89) [0.00, 3.00] Games: 17086 W: 4483 L: 4461 D: 8142 Ptnml(0-2): 149, 2111, 4014, 2107, 162
World	Peregrine	expt-10-output-buckets	diff	N=25000	LLR: 1.79 (-2.25, 2.89) [0.00, 3.00] Games: 50758 W: 17540 L: 17221 D: 15997 Ptnml(0-2): 2149, 5371, 10094, 5542, 2223
World	Peregrine	lmr-pvnode	diff	10.0+0.10	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 30568 W: 7668 L: 7412 D: 15488 Ptnml(0-2): 175, 3559, 7576, 3783, 191
World	Peregrine	conthist-3	diff	10.0+0.10	LLR: -1.68 (-2.25, 2.89) [0.00, 3.00] Games: 34888 W: 8552 L: 8576 D: 17760 Ptnml(0-2): 228, 4248, 8486, 4284, 198
World	Peregrine	conthist-weights-sanity-check	diff	10.0+0.10	LLR: -1.64 (-2.25, 2.89) [0.00, 3.00] Games: 65888 W: 16221 L: 16170 D: 33497 Ptnml(0-2): 367, 8048, 16075, 8075, 379
World	Peregrine	lmr-good-killer	diff	10.0+0.10	LLR: -1.96 (-2.25, 2.89) [0.00, 3.00] Games: 30320 W: 7365 L: 7417 D: 15538 Ptnml(0-2): 179, 3714, 7424, 3666, 177
World	Peregrine	remove-qs-tempo	diff	10.0+0.10	LLR: -0.70 (-2.25, 2.89) [-3.00, 0.00] Games: 10362 W: 2519 L: 2586 D: 5257 Ptnml(0-2): 63, 1258, 2595, 1213, 52
World	Peregrine	skip-history-update	diff	10.0+0.10	LLR: -0.95 (-2.25, 2.89) [0.00, 3.00] Games: 27620 W: 6701 L: 6696 D: 14223 Ptnml(0-2): 151, 3378, 6743, 3391, 147
World	Peregrine	nmp-improving	diff	10.0+0.10	LLR: -0.55 (-2.25, 2.89) [0.00, 3.00] Games: 2254 W: 530 L: 558 D: 1166 Ptnml(0-2): 9, 284, 568, 258, 8
World	Peregrine	nmp-improving	diff	10.0+0.10	LLR: -0.66 (-2.25, 2.89) [0.00, 3.00] Games: 5674 W: 1377 L: 1405 D: 2892 Ptnml(0-2): 37, 697, 1396, 671, 36
World	Peregrine	movepick-check-bonus	diff	10.0+0.10	LLR: -1.36 (-2.25, 2.89) [0.00, 3.00] Games: 4482 W: 1031 L: 1105 D: 2346 Ptnml(0-2): 38, 551, 1119, 513, 20
World	Peregrine	delay-greedy-2	diff	10.0+0.10	Elo: 17.63 +- 12.49 (95%) [N=40000] Games: 868 W: 223 L: 179 D: 466 Ptnml(0-2): 3, 89, 210, 125, 7
World	Peregrine	delay-kaggle-greedy	diff	10.0+0.10	Elo: 14.04 +- 4.34 (95%) [N=40000] Games: 6858 W: 1743 L: 1466 D: 3649 Ptnml(0-2): 30, 697, 1704, 962, 36
World	Peregrine	delay-greedy	diff	10.0+0.04 *	Elo: -14.48 +- 10.30 (95%) [N=40000] Games: 1344 W: 306 L: 362 D: 676 Ptnml(0-2): 10, 199, 306, 151, 6
World	Peregrine	delay-greedy	diff	10.0+0.10	Elo: 31.98 +- 8.33 (95%) [N=40000] Games: 1874 W: 521 L: 349 D: 1004 Ptnml(0-2): 2, 156, 471, 284, 24
World	Peregrine	quiet-check-evasion	diff	10.0+0.10	LLR: -0.32 (-2.25, 2.89) [0.00, 3.00] Games: 1336 W: 318 L: 335 D: 683 Ptnml(0-2): 8, 177, 315, 160, 8
World	Peregrine	delay-greedy	diff	10.0+0.10	Elo: 25.31 +- 6.48 (95%) [N=40000] Games: 3066 W: 841 L: 618 D: 1607 Ptnml(0-2): 9, 282, 734, 493, 15
World	Peregrine	delay	diff	10.0+0.10 *	Elo: 47.41 +- 11.40 (95%) [N=40000] Games: 1084 W: 349 L: 202 D: 533 Ptnml(0-2): 4, 76, 246, 201, 15
World	Peregrine	delay	diff	10.0+0.10 *	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 654 W: 84 L: 294 D: 276 Ptnml(0-2): 31, 170, 105, 20, 1
World	Peregrine	kaggle-simulation	diff	10.0+0.10	Elo: -3.98 +- 3.29 (95%) [N=40000] Games: 11866 W: 2883 L: 3019 D: 5964 Ptnml(0-2): 54, 1494, 2976, 1352, 57
World	Peregrine	remove-pc-early-return	diff	10.0+0.10	LLR: -1.56 (-2.25, 2.89) [-3.00, 0.00] Games: 21514 W: 5211 L: 5359 D: 10944 Ptnml(0-2): 131, 2687, 5272, 2533, 134

1 2 3 56 57 58 59 60 102 103 104