OpenBench

OpenBench Testing Framework

Finished
Peregr	Peregrine	clang	diff	10.0+0.10	LLR: -0.96 (-2.25, 2.89) [-5.00, 0.00] Games: 3664 W: 856 L: 907 D: 1901 Ptnml(0-2): 29, 465, 892, 420, 26
Peregr	Peregrine	spsa4-75k	diff	10.0+0.10	LLR: 0.53 (-2.25, 2.89) [0.00, 5.00] Games: 13066 W: 3264 L: 3192 D: 6610 Ptnml(0-2): 98, 1532, 3209, 1588, 106
Peregr	Peregrine	spsa4	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [0.00, 5.00] Games: 8560 W: 2174 L: 2028 D: 4358 Ptnml(0-2): 45, 1028, 2018, 1114, 75
World	Peregrine	main	diff	10.0+0.10	Elo: 57.35 +- 11.48 (95%) [N=8000] Games: 1736 W: 744 L: 460 D: 532 Ptnml(0-2): 24, 124, 372, 240, 108
World	Peregrine	fast-old-hce	diff	10.0+0.10	Elo: 7.25 +- 6.52 (95%) [N=8000] Games: 3882 W: 1083 L: 1002 D: 1797 Ptnml(0-2): 49, 444, 883, 507, 58
World	Peregrine	main	diff	10.0+0.10	Elo: 4.29 +- 10.14 (95%) [N=8000] Games: 2186 W: 743 L: 716 D: 727 Ptnml(0-2): 56, 264, 453, 237, 83
World	Peregrine	slow-nnue	diff	10.0+0.10	Elo: -21.58 +- 10.44 (95%) [N=8000] Games: 1886 W: 565 L: 682 D: 639 Ptnml(0-2): 61, 251, 419, 168, 44
Peregr	Peregrine	ponderTest2	diff	10.0+0.10	LLR: -0.51 (-2.25, 2.89) [0.00, 5.00] Games: 3938 W: 996 L: 1000 D: 1942 Ptnml(0-2): 39, 464, 950, 494, 22
World	Peregrine	slow-nnue	diff	10.0+0.10	Elo: -21.97 +- 9.24 (95%) [N=8000] Games: 2486 W: 729 L: 886 D: 871 Ptnml(0-2): 90, 322, 543, 231, 57
Peregr	Peregrine	ponderTest	diff	10.0+0.10	LLR: -0.89 (-2.25, 2.89) [0.00, 5.00] Games: 488 W: 118 L: 148 D: 222 Ptnml(0-2): 4, 69, 124, 47, 0
World	Peregrine	fp-simplification	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [-5.00, 0.00] Games: 8572 W: 2210 L: 2132 D: 4230 Ptnml(0-2): 71, 1012, 2041, 1092, 70
World	Peregrine	48-hl-hm	diff	10.0+0.10	Elo: -42.37 +- 7.98 (95%) [N=4000] Games: 2662 W: 585 L: 908 D: 1169 Ptnml(0-2): 72, 438, 577, 229, 15
Peregr	Peregrine	main	diff	10.0+0.10 *	LLR: 2.90 (-2.25, 2.89) [0.00, 5.00] Games: 700 W: 253 L: 116 D: 331 Ptnml(0-2): 3, 36, 152, 139, 20
World	Peregrine	kaggle-version	diff	10.0+0.10 *	LLR: 2.89 (-2.25, 2.89) [0.00, 5.00] Games: 666 W: 263 L: 119 D: 284 Ptnml(0-2): 4, 29, 142, 135, 23
World	Peregrine	smooth-improving	diff	10.0+0.10	LLR: -1.07 (-2.25, 2.89) [0.00, 5.00] Games: 7370 W: 1909 L: 1921 D: 3540 Ptnml(0-2): 69, 913, 1726, 915, 62
World	Peregrine	net-spsa-sanity	diff	10.0+0.10	LLR: -1.18 (-2.25, 2.89) [0.00, 5.00] Games: 19872 W: 5047 L: 5013 D: 9812 Ptnml(0-2): 150, 2447, 4738, 2421, 180
World	Peregrine	main	diff	10.0+0.10	Elo: -105.86 +- 23.47 (95%) [N=4000] Games: 318 W: 50 L: 144 D: 124 Ptnml(0-2): 19, 65, 66, 9, 0
World	Peregrine	kaggle-version	diff	10.0+0.10 *	LLR: 2.16 (-2.25, 2.89) [0.00, 5.00] Games: 386 W: 169 L: 48 D: 169 Ptnml(0-2): 0, 11, 69, 94, 19
World	Peregrine	simplify-last-capture	diff	10.0+0.10	LLR: -1.25 (-2.25, 2.89) [-5.00, 0.00] Games: 17114 W: 4255 L: 4370 D: 8489 Ptnml(0-2): 129, 2127, 4147, 2038, 116
World	Peregrine	main	diff	10.0+0.10 *	LLR: 2.94 (-2.25, 2.89) [0.00, 5.00] Games: 970 W: 303 L: 186 D: 481 Ptnml(0-2): 1, 78, 222, 171, 13
World	Peregrine	cleanups-3	diff	10.0+0.10	LLR: 1.10 (-2.25, 2.89) [-5.00, 0.00] Games: 6144 W: 1574 L: 1556 D: 3014 Ptnml(0-2): 46, 768, 1437, 764, 57
Peregr	Peregrine	vizImproving	diff	10.0+0.10	LLR: -0.73 (-2.25, 2.89) [0.00, 5.00] Games: 2816 W: 703 L: 720 D: 1393 Ptnml(0-2): 27, 346, 673, 341, 21
World	Peregrine	net-spsa	diff	10.0+0.10	Tuning 193 Parameters 1651/25000 Iterations 26424/400000 Games Played
Peregr	Peregrine	vizImproving	diff	10.0+0.10	LLR: 0.00 (-2.25, 2.89) [0.00, 5.00] Games: 0 W: 0 L: 0 D: 0 Ptnml(0-2): 0, 0, 0, 0, 0
World	Peregrine	cleanups-2	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-5.00, 0.00] Games: 18162 W: 4669 L: 4629 D: 8864 Ptnml(0-2): 148, 2186, 4375, 2222, 150

1 2 3 244 245 246 247 248 276 277 278