OpenBench

OpenBench Testing Framework

Finished
World	Reckless	l1-512	diff	120.0+1.20	LLR: 2.91 (-2.25, 2.89) [0.00, 4.00] Games: 23066 W: 5684 L: 5503 D: 11879 Ptnml(0-2): 5, 2434, 6469, 2625, 0	VLTC
World	Reckless	half-rs	diff	8.0+0.08	LLR: 1.99 (-2.25, 2.89) [-2.75, 0.25] Games: 38584 W: 9648 L: 9601 D: 19335 Ptnml(0-2): 89, 4620, 9840, 4641, 102
World	Reckless	l1-512	diff	40.0+0.40	LLR: -0.28 (-2.25, 2.89) [0.00, 3.00] Games: 8006 W: 2012 L: 2011 D: 3983 Ptnml(0-2): 1, 920, 2164, 913, 5
World	Reckless	l1-512	diff	8.0+0.08	LLR: -0.87 (-2.25, 2.89) [0.00, 3.00] Games: 11210 W: 2815 L: 2842 D: 5553 Ptnml(0-2): 37, 1349, 2851, 1340, 28
World	Reckless	l1-512	diff	N=25000	Elo: 15.63 +- 2.22 (95%) [N=40000] Games: 40424 W: 13444 L: 11627 D: 15353 Ptnml(0-2): 815, 4180, 8798, 5211, 1208
World	Reckless	spsa-12	diff	40.0+0.40	Tuning 165 Parameters 4805/25000 Iterations 76886/400000 Games Played	LTC SPSA
World	Reckless	remove-tiling-simd	diff	4.0+0.04	LLR: -2.27 (-2.25, 2.89) [-2.75, 0.25] Games: 18338 W: 4543 L: 4704 D: 9091 Ptnml(0-2): 63, 2035, 5128, 1886, 57
Peregr	Reckless	redun-travesral	diff	4.0+0.04	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 54746 W: 13890 L: 13906 D: 26950 Ptnml(0-2): 173, 5776, 15493, 5756, 175
Peregr	Reckless	fuse-add-subs	diff	4.0+0.04	LLR: -0.14 (-2.25, 2.89) [0.00, 3.00] Games: 18854 W: 4862 L: 4830 D: 9162 Ptnml(0-2): 64, 1984, 5285, 2044, 50
Peregr	Reckless	empty-adds-subs	diff	4.0+0.04	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 16524 W: 4177 L: 4271 D: 8076 Ptnml(0-2): 54, 1843, 4564, 1745, 56
World	Reckless	spsa-12-74k	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 5872 W: 1565 L: 1381 D: 2926 Ptnml(0-2): 7, 629, 1490, 793, 17
World	Reckless	spsa-12-74k	diff	40.0+0.40	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 7994 W: 2021 L: 1841 D: 4132 Ptnml(0-2): 2, 803, 2207, 983, 2
World	Reckless	depth-increase-again	diff	40.0+0.40	LLR: 0.28 (-2.25, 2.89) [0.00, 3.00] Games: 24572 W: 5874 L: 5808 D: 12890 Ptnml(0-2): 6, 2723, 6764, 2785, 8
Peregr	Reckless	skip-outlier	diff	8.0+0.08	LLR: -2.28 (-2.25, 2.89) [0.00, 3.00] Games: 42538 W: 10468 L: 10508 D: 21562 Ptnml(0-2): 75, 4977, 11203, 4941, 73
Styxdo	Reckless	iweis	diff	8.0+0.08	LLR: -2.52 (-2.25, 2.89) [0.00, 3.00] Games: 4026 W: 930 L: 1073 D: 2023 Ptnml(0-2): 14, 565, 994, 430, 10	Direct STC
Peregr	Reckless	qs-exp	diff	8.0+0.08	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 16266 W: 4019 L: 4118 D: 8129 Ptnml(0-2): 28, 1937, 4304, 1834, 30
Peregr	Reckless	no-tb	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [-2.75, 0.25] Games: 14522 W: 3459 L: 3605 D: 7458 Ptnml(0-2): 20, 1549, 4266, 1409, 17	Test if TB support still gains Elo
World	Reckless	remove-tiling	diff	4.0+0.04	Elo: 1.34 +- 4.36 (95%) [N=40000] Games: 5956 W: 1521 L: 1498 D: 2937 Ptnml(0-2): 22, 627, 1658, 648, 23
World	Reckless	depth-increase-again	diff	8.0+0.08	LLR: -1.86 (-2.25, 2.89) [0.00, 3.00] Games: 18304 W: 4520 L: 4589 D: 9195 Ptnml(0-2): 33, 2239, 4672, 2180, 28
World	Reckless	simplify-pcm-raw-eval	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [-2.75, 0.25] Games: 22824 W: 5556 L: 5730 D: 11538 Ptnml(0-2): 47, 2831, 5823, 2671, 40
World	Reckless	simplify-pcm-raw-eval	diff	8.0+0.08	LLR: -0.46 (-2.25, 2.89) [-2.75, 0.25] Games: 70832 W: 17471 L: 17625 D: 35736 Ptnml(0-2): 114, 8440, 18463, 8284, 115	median shift works?
World	Reckless	more-tt-cut-pcm	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 11462 W: 2757 L: 2870 D: 5835 Ptnml(0-2): 22, 1454, 2887, 1351, 17
World	Reckless	iweis	diff	40.0+0.40	Elo: 2.46 +- 3.85 (95%) [N=40000] Games: 7486 W: 1860 L: 1807 D: 3819 Ptnml(0-2): 1, 862, 1965, 913, 2	LTC iweis-s1 vs. rs2-s1
World	Reckless	iweis-s1	diff	8.0+0.08	Elo: 1.06 +- 4.01 (95%) [N=40000] Games: 7534 W: 1912 L: 1889 D: 3733 Ptnml(0-2): 28, 872, 1933, 917, 17	STC iweis-s1 vs. rs2-s1
World	Reckless	s2-full-wdl	diff	40.0+0.40	LLR: -2.30 (-2.25, 2.89) [-3.00, 0.00] Games: 8152 W: 1893 L: 2038 D: 4221 Ptnml(0-2): 4, 1002, 2208, 859, 3

1 2 3 172 173 174 175 176 449 450 451