OpenBench

OpenBench Testing Framework

Finished
World	Reckless	networks	diff	40.0+0.40	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 6138 W: 1434 L: 1549 D: 3155 Ptnml(0-2): 0, 795, 1595, 678, 1	wdl scales, right?!
World	Reckless	networks	diff	8.0+0.08	LLR: -1.95 (-2.25, 2.89) [0.00, 3.00] Games: 9480 W: 2344 L: 2439 D: 4697 Ptnml(0-2): 20, 1221, 2357, 1118, 24
World	Reckless	networks	diff	N=25000	Elo: -1.96 +- 2.24 (95%) [N=40000] Games: 40802 W: 12589 L: 12819 D: 15394 Ptnml(0-2): 1062, 4852, 8790, 4648, 1049
World	Reckless	spsa-13-35k	diff	40.0+0.40	LLR: -0.18 (-2.25, 2.89) [0.00, 3.00] Games: 8854 W: 2178 L: 2170 D: 4506 Ptnml(0-2): 1, 970, 2476, 980, 0	LTC
World	Reckless	spsa-13-35k	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 37122 W: 9322 L: 9072 D: 18728 Ptnml(0-2): 65, 4311, 9559, 4561, 65	STC
World	Reckless	spsa-13	diff	120.0+1.20	Tuning 165 Parameters 4367/25000 Iterations 34940/200000 Games Played	VLTC SPSA
World	Reckless	full-wdl *	diff	8.0+0.08	LLR: 3.02 (-2.25, 2.89) [0.00, 3.00] Games: 10264 W: 1763 L: 1581 D: 6920 Ptnml(0-2): 31, 874, 3148, 1040, 39	DFRC
World	Reckless	full-wdl	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 12862 W: 3223 L: 3034 D: 6605 Ptnml(0-2): 3, 1400, 3437, 1587, 4
World	Reckless	full-wdl	diff	8.0+0.08	LLR: 2.93 (-2.25, 2.89) [0.00, 3.00] Games: 9872 W: 2551 L: 2356 D: 4965 Ptnml(0-2): 22, 1095, 2515, 1274, 30
World	Reckless	full-wdl	diff	N=25000	Elo: 2.93 +- 2.23 (95%) [N=40000] Games: 40090 W: 12525 L: 12187 D: 15378 Ptnml(0-2): 960, 4585, 8643, 4871, 986
World	Reckless	main	diff	40.0+0.40 * *	Elo: 10.60 +- 9.74 (95%) [N=40000] Games: 1016 W: 268 L: 237 D: 511 Ptnml(0-2): 0, 89, 300, 118, 1	[Threads=4 Hash=256 40.0+0.4] vs. [Threads=1 Hash=256 120.0+1.2] (700000 NPS)
World	Reckless	spsa-12-74k	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [0.00, 4.00] Games: 26804 W: 6498 L: 6312 D: 13994 Ptnml(0-2): 1, 2706, 7802, 2892, 1	[Threads=4 Hash=256]
World	Reckless	l1-512	diff	120.0+1.20	LLR: 2.91 (-2.25, 2.89) [0.00, 4.00] Games: 23066 W: 5684 L: 5503 D: 11879 Ptnml(0-2): 5, 2434, 6469, 2625, 0	VLTC
World	Reckless	half-rs	diff	8.0+0.08	LLR: 1.99 (-2.25, 2.89) [-2.75, 0.25] Games: 38584 W: 9648 L: 9601 D: 19335 Ptnml(0-2): 89, 4620, 9840, 4641, 102
World	Reckless	l1-512	diff	40.0+0.40	LLR: -0.28 (-2.25, 2.89) [0.00, 3.00] Games: 8006 W: 2012 L: 2011 D: 3983 Ptnml(0-2): 1, 920, 2164, 913, 5
World	Reckless	l1-512	diff	8.0+0.08	LLR: -0.87 (-2.25, 2.89) [0.00, 3.00] Games: 11210 W: 2815 L: 2842 D: 5553 Ptnml(0-2): 37, 1349, 2851, 1340, 28
World	Reckless	l1-512	diff	N=25000	Elo: 15.63 +- 2.22 (95%) [N=40000] Games: 40424 W: 13444 L: 11627 D: 15353 Ptnml(0-2): 815, 4180, 8798, 5211, 1208
World	Reckless	spsa-12	diff	40.0+0.40	Tuning 165 Parameters 4805/25000 Iterations 76886/400000 Games Played	LTC SPSA
World	Reckless	remove-tiling-simd	diff	4.0+0.04	LLR: -2.27 (-2.25, 2.89) [-2.75, 0.25] Games: 18338 W: 4543 L: 4704 D: 9091 Ptnml(0-2): 63, 2035, 5128, 1886, 57
World	Reckless	spsa-12-74k	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 5872 W: 1565 L: 1381 D: 2926 Ptnml(0-2): 7, 629, 1490, 793, 17
World	Reckless	spsa-12-74k	diff	40.0+0.40	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 7994 W: 2021 L: 1841 D: 4132 Ptnml(0-2): 2, 803, 2207, 983, 2
World	Reckless	depth-increase-again	diff	40.0+0.40	LLR: 0.28 (-2.25, 2.89) [0.00, 3.00] Games: 24572 W: 5874 L: 5808 D: 12890 Ptnml(0-2): 6, 2723, 6764, 2785, 8
World	Reckless	remove-tiling	diff	4.0+0.04	Elo: 1.34 +- 4.36 (95%) [N=40000] Games: 5956 W: 1521 L: 1498 D: 2937 Ptnml(0-2): 22, 627, 1658, 648, 23
World	Reckless	depth-increase-again	diff	8.0+0.08	LLR: -1.86 (-2.25, 2.89) [0.00, 3.00] Games: 18304 W: 4520 L: 4589 D: 9195 Ptnml(0-2): 33, 2239, 4672, 2180, 28
World	Reckless	simplify-pcm-raw-eval	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [-2.75, 0.25] Games: 22824 W: 5556 L: 5730 D: 11538 Ptnml(0-2): 47, 2831, 5823, 2671, 40

1 2 3 20 21 22 23 24 216 217 218