OpenBench

OpenBench Testing Framework

Finished
World	Reckless	see-expt	diff	8.0+0.08	LLR: -0.46 (-2.25, 2.89) [0.00, 3.00] Games: 6232 W: 1529 L: 1542 D: 3161 Ptnml(0-2): 10, 755, 1600, 740, 11
World	Reckless	decouple-see-4	diff	40.0+0.40	LLR: -0.53 (-2.25, 2.89) [-3.00, 0.00] Games: 16602 W: 3929 L: 3993 D: 8680 Ptnml(0-2): 4, 1931, 4492, 1873, 1
World	Reckless	lmr-red-expt	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 6228 W: 1477 L: 1595 D: 3156 Ptnml(0-2): 14, 788, 1620, 686, 6
World	Reckless	switch-sbs-s1	diff	8.0+0.08	Elo: 0.42 +- 3.38 (95%) [N=40000] Games: 10872 W: 2734 L: 2721 D: 5417 Ptnml(0-2): 48, 1268, 2782, 1299, 39	switch-sbs-s1 vs. v50-s1
World	Reckless	networks	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 7504 W: 1826 L: 1945 D: 3733 Ptnml(0-2): 20, 961, 1911, 838, 22
World	Reckless	networks	diff	N=25000	Elo: -4.69 +- 3.03 (95%) [N=40000] Games: 22278 W: 6789 L: 7090 D: 8399 Ptnml(0-2): 597, 2698, 4815, 2467, 562
World	Reckless	numa-2	diff	4.0+0.04	LLR: -0.64 (-2.25, 2.89) [-3.00, 0.00] Games: 11322 W: 2796 L: 2857 D: 5669 Ptnml(0-2): 43, 1265, 3093, 1230, 30	[Threads=1 Hash=16]
World	Reckless	networks	diff	8.0+0.08	Elo: -26.93 +- 4.65 (95%) [N=40000] Games: 5740 W: 1245 L: 1689 D: 2806 Ptnml(0-2): 23, 932, 1392, 512, 11	s1 vs. s2
World	Reckless	decouple-see-3	diff	40.0+0.40	LLR: -0.31 (-2.25, 2.89) [-3.00, 0.00] Games: 7290 W: 1757 L: 1790 D: 3743 Ptnml(0-2): 2, 871, 1931, 840, 1
World	Reckless	decouple-see-3	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [-2.75, 0.25] Games: 11494 W: 2880 L: 2732 D: 5882 Ptnml(0-2): 13, 1292, 3003, 1412, 27
World	Reckless	residual-conn	diff	8.0+0.08	LLR: -1.46 (-2.25, 2.89) [0.00, 3.00] Games: 15594 W: 3889 L: 3941 D: 7764 Ptnml(0-2): 36, 1905, 3967, 1853, 36
World	Reckless	decouple-see-2	diff	8.0+0.08	LLR: 0.59 (-2.25, 2.89) [0.00, 3.00] Games: 9280 W: 2325 L: 2271 D: 4684 Ptnml(0-2): 15, 1070, 2414, 1128, 13
World	Reckless	residual-conn	diff	N=25000	Elo: -5.32 +- 2.72 (95%) [N=40000] Games: 27612 W: 8381 L: 8804 D: 10427 Ptnml(0-2): 754, 3359, 5902, 3138, 653
World	Reckless	decouple-see-2	diff	8.0+0.08	Tuning 5 Parameters 1248/5000 Iterations 19974/80000 Games Played
World	Reckless	decouple-see-2	diff	8.0+0.08	Elo: -0.60 +- 3.75 (95%) [N=40000] Games: 8116 W: 2024 L: 2038 D: 4054 Ptnml(0-2): 9, 967, 2122, 949, 11
World	Reckless	decouple-see	diff	8.0+0.08	LLR: -0.59 (-2.25, 2.89) [0.00, 3.00] Games: 15430 W: 3815 L: 3816 D: 7799 Ptnml(0-2): 28, 1839, 3984, 1834, 30
World	Reckless	networks	diff	8.0+0.08	Elo: -1.61 +- 1.78 (95%) [N=40000] Games: 40004 W: 10100 L: 10285 D: 19619 Ptnml(0-2): 141, 4954, 10042, 4679, 186	obs-in-s1 vs. v50
World	Reckless	obs-in-s1	diff	N=25000	Elo: -3.04 +- 1.94 (95%) [N=80000] Games: 53344 W: 16357 L: 16823 D: 20164 Ptnml(0-2): 1374, 6367, 11612, 5989, 1330	obs-in-s1 vs. v50
Peregr	Reckless	pc-prevmv3	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 29874 W: 7339 L: 7405 D: 15130 Ptnml(0-2): 53, 3562, 7759, 3524, 39
Peregr	Reckless	pc-prevmv	diff	8.0+0.08	LLR: -0.89 (-2.25, 2.89) [0.00, 3.00] Games: 3464 W: 840 L: 884 D: 1740 Ptnml(0-2): 2, 442, 891, 392, 5
Peregr	Reckless	pc-incheck	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 19372 W: 4710 L: 4807 D: 9855 Ptnml(0-2): 33, 2365, 4995, 2252, 41
World	Reckless	verify-ltc	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [-3.00, 0.00] Games: 50868 W: 12320 L: 12264 D: 26284 Ptnml(0-2): 11, 5679, 14005, 5721, 18	verify the PV reduction patch at LTC, should fail
World	Reckless	simplify-nmp-3	diff	8.0+0.08	LLR: -1.17 (-2.25, 2.89) [-2.75, 0.25] Games: 19638 W: 4773 L: 4876 D: 9989 Ptnml(0-2): 38, 2369, 5099, 2284, 29
World	Reckless	probcut-eval-beta	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 8970 W: 2153 L: 2270 D: 4547 Ptnml(0-2): 19, 1110, 2340, 1001, 15
World	Reckless	memmap-test	diff	8.0+0.08	Elo: -1.39 +- 11.52 (95%) [N=4000] Games: 748 W: 191 L: 194 D: 363 Ptnml(0-2): 0, 81, 215, 78, 0	[Threads=120 Hash=2048]

1 2 3 31 32 33 34 35 312 313 314