OpenBench

OpenBench Testing Framework

Finished
Peregr	Reckless	score-imp	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 73424 W: 18157 L: 18129 D: 37138 Ptnml(0-2): 140, 8710, 18995, 8716, 151
World	Reckless	spsa-13-35k	diff	40.0+0.40	LLR: -0.18 (-2.25, 2.89) [0.00, 3.00] Games: 8854 W: 2178 L: 2170 D: 4506 Ptnml(0-2): 1, 970, 2476, 980, 0	LTC
World	Reckless	spsa-13-35k	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 37122 W: 9322 L: 9072 D: 18728 Ptnml(0-2): 65, 4311, 9559, 4561, 65	STC
World	Reckless	spsa-13	diff	120.0+1.20	Tuning 165 Parameters 4367/25000 Iterations 34940/200000 Games Played	VLTC SPSA
Peregr	Reckless	act-depth-pv2	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 16742 W: 4108 L: 4208 D: 8426 Ptnml(0-2): 23, 1953, 4518, 1855, 22	appreciate triple-extended PVS more
World	Reckless	full-wdl *	diff	8.0+0.08	LLR: 3.02 (-2.25, 2.89) [0.00, 3.00] Games: 10264 W: 1763 L: 1581 D: 6920 Ptnml(0-2): 31, 874, 3148, 1040, 39	DFRC
World	Reckless	full-wdl	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 12862 W: 3223 L: 3034 D: 6605 Ptnml(0-2): 3, 1400, 3437, 1587, 4
World	Reckless	full-wdl	diff	8.0+0.08	LLR: 2.93 (-2.25, 2.89) [0.00, 3.00] Games: 9872 W: 2551 L: 2356 D: 4965 Ptnml(0-2): 22, 1095, 2515, 1274, 30
Peregr	Reckless	lmp-potent2	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 24764 W: 5940 L: 6017 D: 12807 Ptnml(0-2): 44, 2958, 6447, 2897, 36	Assume it's less likely to find another move apart from the tt_move when we precisely extended the tt_move and judged that other moves were bad
World	Reckless	full-wdl	diff	N=25000	Elo: 2.93 +- 2.23 (95%) [N=40000] Games: 40090 W: 12525 L: 12187 D: 15378 Ptnml(0-2): 960, 4585, 8643, 4871, 986
World	Reckless	main	diff	40.0+0.40 * *	Elo: 10.60 +- 9.74 (95%) [N=40000] Games: 1016 W: 268 L: 237 D: 511 Ptnml(0-2): 0, 89, 300, 118, 1	[Threads=4 Hash=256 40.0+0.4] vs. [Threads=1 Hash=256 120.0+1.2] (700000 NPS)
World	Reckless	spsa-12-74k	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [0.00, 4.00] Games: 26804 W: 6498 L: 6312 D: 13994 Ptnml(0-2): 1, 2706, 7802, 2892, 1	[Threads=4 Hash=256]
World	Reckless	l1-512	diff	120.0+1.20	LLR: 2.91 (-2.25, 2.89) [0.00, 4.00] Games: 23066 W: 5684 L: 5503 D: 11879 Ptnml(0-2): 5, 2434, 6469, 2625, 0	VLTC
World	Reckless	half-rs	diff	8.0+0.08	LLR: 1.99 (-2.25, 2.89) [-2.75, 0.25] Games: 38584 W: 9648 L: 9601 D: 19335 Ptnml(0-2): 89, 4620, 9840, 4641, 102
World	Reckless	l1-512	diff	40.0+0.40	LLR: -0.28 (-2.25, 2.89) [0.00, 3.00] Games: 8006 W: 2012 L: 2011 D: 3983 Ptnml(0-2): 1, 920, 2164, 913, 5
World	Reckless	l1-512	diff	8.0+0.08	LLR: -0.87 (-2.25, 2.89) [0.00, 3.00] Games: 11210 W: 2815 L: 2842 D: 5553 Ptnml(0-2): 37, 1349, 2851, 1340, 28
World	Reckless	l1-512	diff	N=25000	Elo: 15.63 +- 2.22 (95%) [N=40000] Games: 40424 W: 13444 L: 11627 D: 15353 Ptnml(0-2): 815, 4180, 8798, 5211, 1208
World	Reckless	spsa-12	diff	40.0+0.40	Tuning 165 Parameters 4805/25000 Iterations 76886/400000 Games Played	LTC SPSA
World	Reckless	remove-tiling-simd	diff	4.0+0.04	LLR: -2.27 (-2.25, 2.89) [-2.75, 0.25] Games: 18338 W: 4543 L: 4704 D: 9091 Ptnml(0-2): 63, 2035, 5128, 1886, 57
Peregr	Reckless	redun-travesral	diff	4.0+0.04	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 54746 W: 13890 L: 13906 D: 26950 Ptnml(0-2): 173, 5776, 15493, 5756, 175
Peregr	Reckless	fuse-add-subs	diff	4.0+0.04	LLR: -0.14 (-2.25, 2.89) [0.00, 3.00] Games: 18854 W: 4862 L: 4830 D: 9162 Ptnml(0-2): 64, 1984, 5285, 2044, 50
Peregr	Reckless	empty-adds-subs	diff	4.0+0.04	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 16524 W: 4177 L: 4271 D: 8076 Ptnml(0-2): 54, 1843, 4564, 1745, 56
World	Reckless	spsa-12-74k	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 5872 W: 1565 L: 1381 D: 2926 Ptnml(0-2): 7, 629, 1490, 793, 17
World	Reckless	spsa-12-74k	diff	40.0+0.40	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 7994 W: 2021 L: 1841 D: 4132 Ptnml(0-2): 2, 803, 2207, 983, 2
World	Reckless	depth-increase-again	diff	40.0+0.40	LLR: 0.28 (-2.25, 2.89) [0.00, 3.00] Games: 24572 W: 5874 L: 5808 D: 12890 Ptnml(0-2): 6, 2723, 6764, 2785, 8

1 2 3 35 36 37 38 39 313 314 315