OpenBench

OpenBench Testing Framework

Finished
World	Reckless	batman-09	diff	N=25000	Elo: -0.56 +- 2.23 (95%) [N=40000] Games: 40702 W: 12737 L: 12803 D: 15162 Ptnml(0-2): 986, 4827, 8906, 4531, 1101
World	Reckless	batman	diff	8.0+0.08	LLR: 2.96 (-2.25, 2.89) [0.00, 3.00] Games: 18460 W: 4956 L: 4731 D: 8773 Ptnml(0-2): 60, 2213, 4512, 2332, 113	STC vs. main
World	Reckless	batman-dual	diff	8.0+0.08	LLR: -1.01 (-2.25, 2.89) [0.00, 3.00] Games: 10836 W: 2686 L: 2722 D: 5428 Ptnml(0-2): 39, 1301, 2761, 1291, 26
World	Reckless	batman	diff	40.0+0.40	LLR: 0.37 (-2.25, 2.89) [0.00, 4.00] Games: 4030 W: 1013 L: 987 D: 2030 Ptnml(0-2): 0, 424, 1143, 446, 2	[Threads=4 Hash=256]
World	Reckless	batman	diff	40.0+0.40	LLR: 1.03 (-2.25, 2.89) [0.00, 3.00] Games: 12180 W: 3092 L: 3008 D: 6080 Ptnml(0-2): 10, 1375, 3231, 1469, 5	The contingency plan
World	Reckless	batman-dual	diff	N=25000	Elo: 0.02 +- 2.23 (95%) [N=40000] Games: 40488 W: 12611 L: 12609 D: 15268 Ptnml(0-2): 1003, 4767, 8740, 4693, 1041
World	Reckless	batman	diff	8.0+0.08	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 20756 W: 5459 L: 5233 D: 10064 Ptnml(0-2): 61, 2428, 5200, 2602, 87	The contingency plan
World	Reckless	batman	diff	N=25000	Elo: 28.05 +- 2.31 (95%) [N=40000] Games: 40240 W: 14547 L: 11305 D: 14388 Ptnml(0-2): 759, 3848, 8569, 5280, 1664	The contingency plan
World	Reckless	spsa-11	diff	40.0+0.40	Tuning 145 Parameters 8260/25000 Iterations 132172/400000 Games Played	LTC SMP tuning session [Threads=4 Hash=256]
World	Reckless	batman-better-fusing	diff	4.0+0.04	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 16854 W: 4177 L: 4269 D: 8408 Ptnml(0-2): 47, 1785, 4857, 1689, 49
World	Reckless	batman-lut	diff	4.0+0.04	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 5634 W: 1532 L: 1353 D: 2749 Ptnml(0-2): 16, 536, 1540, 703, 22
World	Reckless	batman-07	diff	8.0+0.08	LLR: -2.32 (-2.25, 2.89) [0.00, 3.00] Games: 5156 W: 1200 L: 1326 D: 2630 Ptnml(0-2): 18, 682, 1292, 580, 6
World	Reckless	batman-07	diff	N=25000	Elo: -6.70 +- 2.22 (95%) [N=40000] Games: 40308 W: 12056 L: 12833 D: 15419 Ptnml(0-2): 1056, 4977, 8713, 4504, 904
World	Reckless	batman-06	diff	8.0+0.08	LLR: -2.42 (-2.25, 2.89) [0.00, 3.00] Games: 15550 W: 3828 L: 3936 D: 7786 Ptnml(0-2): 45, 1887, 4009, 1799, 35
World	Reckless	batman-styx-01	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 5224 W: 1223 L: 1347 D: 2654 Ptnml(0-2): 21, 693, 1297, 591, 10
World	Reckless	batman-styx-01	diff	N=25000	Elo: -7.66 +- 2.22 (95%) [N=40000] Games: 40722 W: 12273 L: 13171 D: 15278 Ptnml(0-2): 1177, 4864, 8894, 4532, 894
World	Reckless	batman-06	diff	N=25000	Elo: -4.90 +- 2.23 (95%) [N=40000] Games: 40794 W: 12467 L: 13042 D: 15285 Ptnml(0-2): 1072, 5009, 8724, 4606, 986
World	Reckless	spsa-11-93k	diff	10.0+0.10	LLR: 1.45 (-2.25, 2.89) [0.00, 5.00] Games: 60982 W: 15091 L: 14829 D: 31062 Ptnml(0-2): 41, 6895, 16354, 7163, 38	[Threads=4 Hash=256]
World	Reckless	batman-beta1	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 7896 W: 1918 L: 2035 D: 3943 Ptnml(0-2): 20, 997, 2028, 886, 17
World	Reckless	batman-beta1	diff	N=25000	Elo: 0.49 +- 2.24 (95%) [N=40000] Games: 40098 W: 12576 L: 12520 D: 15002 Ptnml(0-2): 972, 4702, 8695, 4658, 1022
World	Reckless	batman	diff	40.0+0.40	LLR: 1.05 (-2.25, 2.89) [0.00, 3.00] Games: 1760 W: 462 L: 400 D: 898 Ptnml(0-2): 1, 169, 477, 233, 0	[Threads=4 Hash=256]
World	Reckless	batman	diff	40.0+0.40	LLR: -0.77 (-2.25, 2.89) [0.00, 3.00] Games: 4380 W: 1068 L: 1102 D: 2210 Ptnml(0-2): 3, 519, 1180, 485, 3
World	Reckless	batman-naive-i8	diff	8.0+0.08	Elo: -3.58 +- 2.31 (95%) [N=40000] Games: 23590 W: 6088 L: 6331 D: 11171 Ptnml(0-2): 91, 2952, 5956, 2701, 95	L1=384 with i8 quantization vs. main
World	Reckless	fix-tiling	diff	4.0+0.04	LLR: 0.28 (-2.25, 2.89) [0.00, 3.00] Games: 27350 W: 6886 L: 6813 D: 13651 Ptnml(0-2): 79, 2861, 7716, 2946, 73
World	Reckless	batman-naive-i8	diff	8.0+0.08	LLR: 2.95 (-2.25, 2.89) [0.00, 3.00] Games: 12414 W: 3139 L: 2940 D: 6335 Ptnml(0-2): 22, 1383, 3203, 1572, 27

1 2 3 80 81 82 83 84 270 271 272