OpenBench

OpenBench Testing Framework

Finished
World	Reckless	tt-cuts-count	diff	8.0+0.08	LLR: 1.91 (-2.25, 2.89) [0.00, 3.00] Games: 28022 W: 7162 L: 6989 D: 13871 Ptnml(0-2): 52, 3279, 7176, 3452, 52
World	Reckless	evasions	diff	8.0+0.08	LLR: -2.04 (-2.25, 2.89) [0.00, 3.00] Games: 12154 W: 3002 L: 3094 D: 6058 Ptnml(0-2): 22, 1489, 3141, 1409, 16
World	Reckless	evasions-scoring	diff	8.0+0.08	LLR: -1.91 (-2.25, 2.89) [0.00, 3.00] Games: 17564 W: 4421 L: 4495 D: 8648 Ptnml(0-2): 42, 2152, 4462, 2090, 36
World	Reckless	spsa-8-fewer-30k	diff	40.0+0.40	LLR: -1.95 (-2.25, 2.89) [0.00, 3.00] Games: 29848 W: 7273 L: 7320 D: 15255 Ptnml(0-2): 11, 3529, 7889, 3486, 9	LTC
World	Reckless	spsa-8-fewer-30k	diff	8.0+0.08	LLR: -0.59 (-2.25, 2.89) [0.00, 3.00] Games: 5252 W: 1338 L: 1361 D: 2553 Ptnml(0-2): 14, 635, 1349, 616, 12	STC
World	Reckless	spsa-8	diff	N=25000	Elo: -0.24 +- 2.18 (95%) [N=40000] Games: 41326 W: 12737 L: 12766 D: 15823 Ptnml(0-2): 1007, 4734, 9176, 4773, 973
World	Reckless	probcut-see-threshold-2	diff	8.0+0.08	LLR: -2.41 (-2.25, 2.89) [0.00, 3.00] Games: 4826 W: 1155 L: 1288 D: 2383 Ptnml(0-2): 21, 628, 1242, 507, 15	probcut-see-threshold-2
World	Reckless	se-margin-quiet	diff	40.0+0.40	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 2276 W: 525 L: 648 D: 1103 Ptnml(0-2): 3, 323, 607, 204, 1	se-margin-quiet
World	Reckless	eval-stability-pow	diff	8.0+0.08	LLR: -2.40 (-2.25, 2.89) [0.00, 3.00] Games: 9734 W: 2442 L: 2560 D: 4732 Ptnml(0-2): 27, 1165, 2599, 1051, 25
World	Reckless	tm-random-2	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 5976 W: 1466 L: 1591 D: 2919 Ptnml(0-2): 22, 741, 1585, 620, 20
World	Reckless	tm-random-3	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 10032 W: 2491 L: 2603 D: 4938 Ptnml(0-2): 23, 1242, 2595, 1136, 20
World	Reckless	tm-random-1	diff	8.0+0.08	LLR: -2.47 (-2.25, 2.89) [0.00, 3.00] Games: 4140 W: 958 L: 1096 D: 2086 Ptnml(0-2): 9, 580, 1029, 444, 8
World	Reckless	corrhist-lower-max	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 49290 W: 12436 L: 12461 D: 24393 Ptnml(0-2): 119, 5865, 12684, 5876, 101
World	Reckless	corrhist-double-size	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 19410 W: 4906 L: 4999 D: 9505 Ptnml(0-2): 41, 2417, 4888, 2312, 47
World	Reckless	neg-ext-4	diff	8.0+0.08	LLR: -2.41 (-2.25, 2.89) [0.00, 3.00] Games: 4162 W: 1012 L: 1147 D: 2003 Ptnml(0-2): 19, 553, 1066, 430, 13
World	Reckless	se-lower-depth	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 4026 W: 971 L: 1100 D: 1955 Ptnml(0-2): 10, 543, 1034, 418, 8
World	Reckless	styx-idea	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 4726 W: 1149 L: 1273 D: 2304 Ptnml(0-2): 14, 632, 1189, 520, 8
World	Reckless	nmp-thing	diff	8.0+0.08	LLR: -2.34 (-2.25, 2.89) [0.00, 3.00] Games: 3630 W: 873 L: 1006 D: 1751 Ptnml(0-2): 14, 510, 893, 391, 7
World	Reckless	pcm-linear-depth-2	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 5472 W: 1326 L: 1451 D: 2695 Ptnml(0-2): 23, 710, 1383, 609, 11
World	Reckless	iir-before-probcut-again	diff	40.0+0.40	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 4130 W: 951 L: 1070 D: 2109 Ptnml(0-2): 3, 540, 1096, 425, 1
World	Reckless	rfp-fail-firm-again-2	diff	40.0+0.40	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 3688 W: 846 L: 967 D: 1875 Ptnml(0-2): 4, 490, 975, 373, 2
World	Reckless	simplify-post-lmr-2	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [-3.00, 0.00] Games: 5442 W: 1316 L: 1464 D: 2662 Ptnml(0-2): 20, 731, 1364, 589, 17
World	Reckless	more-post-lmr-2	diff	8.0+0.08	LLR: -2.32 (-2.25, 2.89) [0.00, 3.00] Games: 9498 W: 2371 L: 2487 D: 4640 Ptnml(0-2): 28, 1182, 2438, 1080, 21
World	Reckless	simplify-fds-2	diff	8.0+0.08	LLR: -2.28 (-2.25, 2.89) [-3.00, 0.00] Games: 12280 W: 3044 L: 3205 D: 6031 Ptnml(0-2): 34, 1528, 3175, 1371, 32
World	Reckless	simplify-fds	diff	8.0+0.08	LLR: -2.38 (-2.25, 2.89) [-3.00, 0.00] Games: 8462 W: 2048 L: 2210 D: 4204 Ptnml(0-2): 27, 1125, 2080, 981, 18

1 2 3 36 37 38 39 40 192 193 194