OpenBench

OpenBench Testing Framework

Finished
World	Reckless	iweis	diff	8.0+0.08	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 15518 W: 3834 L: 3937 D: 7747 Ptnml(0-2): 32, 1921, 3957, 1816, 33	actual iweis
World	Reckless	networks	diff	8.0+0.08	LLR: -0.60 (-2.25, 2.89) [0.00, 3.00] Games: 3224 W: 807 L: 835 D: 1582 Ptnml(0-2): 6, 400, 827, 374, 5	iweis
World	Reckless	no-pv-iir	diff	8.0+0.08	LLR: -0.26 (-2.25, 2.89) [-2.75, 0.25] Games: 26112 W: 6430 L: 6492 D: 13190 Ptnml(0-2): 40, 3133, 6782, 3051, 50
World	Reckless	tt-noisy-fp	diff	8.0+0.08	LLR: -2.42 (-2.25, 2.89) [0.00, 3.00] Games: 9116 W: 2175 L: 2298 D: 4643 Ptnml(0-2): 24, 1155, 2317, 1044, 18
World	Reckless	remove-callback	diff	4.0+0.04	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 14500 W: 3616 L: 3714 D: 7170 Ptnml(0-2): 42, 1545, 4165, 1465, 33	remove-callback but without branching
World	Reckless	remove-callback	diff	4.0+0.04	LLR: -1.13 (-2.25, 2.89) [0.00, 3.00] Games: 3856 W: 951 L: 1004 D: 1901 Ptnml(0-2): 9, 404, 1154, 353, 8
World	Reckless	compute-ray-speedup	diff	4.0+0.04	LLR: 0.45 (-2.25, 2.89) [0.00, 3.00] Games: 16062 W: 4108 L: 4049 D: 7905 Ptnml(0-2): 59, 1646, 4548, 1733, 45
World	Reckless	speedup-1	diff	4.0+0.04	LLR: -2.00 (-2.25, 2.89) [0.00, 3.00] Games: 17078 W: 4299 L: 4377 D: 8402 Ptnml(0-2): 65, 1858, 4774, 1774, 68
World	Reckless	networks	diff	8.0+0.08	Elo: -8.48 +- 3.28 (95%) [N=40000] Games: 11316 W: 2746 L: 3022 D: 5548 Ptnml(0-2): 31, 1514, 2834, 1258, 21	rs5
World	Reckless	networks	diff	8.0+0.08	Elo: -2.30 +- 1.92 (95%) [N=40000] Games: 26912 W: 6519 L: 6697 D: 13696 Ptnml(0-2): 51, 2767, 8004, 2577, 57	rs5-s1 vs. rs2-s1
World	Reckless	full-rs2 *	diff	8.0+0.08	LLR: -0.72 (-2.25, 2.89) [0.00, 3.00] Games: 6934 W: 1161 L: 1186 D: 4587 Ptnml(0-2): 22, 671, 2119, 620, 35	DFRC
World	Reckless	networks	diff	40.0+0.40	LLR: -1.48 (-2.25, 2.89) [0.00, 3.00] Games: 4004 W: 933 L: 1008 D: 2063 Ptnml(0-2): 1, 503, 1070, 426, 2
World	Reckless	networks	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 8902 W: 2211 L: 2327 D: 4364 Ptnml(0-2): 24, 1121, 2272, 1015, 19
World	Reckless	early-game-tm	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 6672 W: 1589 L: 1706 D: 3377 Ptnml(0-2): 16, 840, 1731, 743, 6
World	Reckless	early-game-tm	diff	8.0+0.08	LLR: -0.77 (-2.25, 2.89) [0.00, 3.00] Games: 9446 W: 2332 L: 2356 D: 4758 Ptnml(0-2): 19, 1073, 2562, 1051, 18
World	Reckless	early-game-tm	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 4134 W: 946 L: 1072 D: 2116 Ptnml(0-2): 11, 547, 1073, 429, 7
World	Reckless	rfp-marginal-improving	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 7524 W: 1832 L: 1948 D: 3744 Ptnml(0-2): 18, 951, 1934, 847, 12
World	Reckless	see-one-shot	diff	8.0+0.08	LLR: -2.34 (-2.25, 2.89) [0.00, 3.00] Games: 55050 W: 13515 L: 13532 D: 28003 Ptnml(0-2): 89, 6608, 14161, 6565, 102
World	Reckless	networks	diff	40.0+0.40	LLR: -1.68 (-2.25, 2.89) [0.00, 3.00] Games: 2956 W: 676 L: 762 D: 1518 Ptnml(0-2): 0, 374, 816, 288, 0	wdl-insanity
World	Reckless	networks	diff	8.0+0.08	LLR: -0.63 (-2.25, 2.89) [0.00, 3.00] Games: 7854 W: 1992 L: 2012 D: 3850 Ptnml(0-2): 17, 953, 2016, 915, 26	wdl-insanity
World	Reckless	lmr-depth-ttpv-reduction	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 16942 W: 4116 L: 4217 D: 8609 Ptnml(0-2): 23, 2037, 4453, 1934, 24	linearly add more reduction to ttpv nodes
World	Reckless	less-lmp	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 37968 W: 9453 L: 9504 D: 19011 Ptnml(0-2): 70, 4493, 9893, 4474, 54
World	Reckless	probcut-log-depth-2	diff	40.0+0.40	LLR: -0.47 (-2.25, 2.89) [0.00, 3.00] Games: 6762 W: 1582 L: 1594 D: 3586 Ptnml(0-2): 0, 783, 1828, 769, 1
World	Reckless	networks	diff	40.0+0.40	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 7832 W: 1879 L: 1989 D: 3964 Ptnml(0-2): 3, 961, 2097, 853, 2
World	Reckless	main	diff	40.0+0.40	Elo: 31.38 +- 3.35 (95%) [N=10000] Games: 10002 W: 2980 L: 2079 D: 4943 Ptnml(0-2): 5, 782, 2540, 1655, 19	LTC PT

1 2 3 37 38 39 40 41 313 314 315