OpenBench

OpenBench Testing Framework

Finished
World	Reckless	fp-extract-history	diff	8.0+0.08	LLR: 0.01 (-2.25, 2.89) [0.00, 3.00] Games: 3268 W: 836 L: 828 D: 1604 Ptnml(0-2): 2, 400, 827, 398, 7
World	Reckless	fact	diff	8.0+0.08	LLR: -2.37 (-2.25, 2.89) [0.00, 3.00] Games: 6580 W: 1626 L: 1755 D: 3199 Ptnml(0-2): 30, 855, 1641, 742, 22
World	Reckless	fp-alpha-compensation	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 63680 W: 15951 L: 15641 D: 32088 Ptnml(0-2): 137, 7507, 16246, 7809, 141
World	Reckless	fp-best-move-5	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 8406 W: 2079 L: 2195 D: 4132 Ptnml(0-2): 23, 1076, 2117, 968, 19
World	Reckless	rfp-min-margin	diff	8.0+0.08	LLR: 2.99 (-2.25, 2.89) [0.00, 3.00] Games: 26380 W: 6746 L: 6510 D: 13124 Ptnml(0-2): 65, 3092, 6631, 3346, 56
World	Reckless	simplify-nmp-red	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [-3.00, 0.00] Games: 24056 W: 5978 L: 6165 D: 11913 Ptnml(0-2): 60, 2991, 6111, 2808, 58
World	Reckless	lmp-common-base	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 9462 W: 2324 L: 2441 D: 4697 Ptnml(0-2): 30, 1202, 2386, 1081, 32
World	Reckless	not-relevant-anymore	diff	4.0+0.04	LLR: 2.90 (-2.25, 2.89) [-3.00, 0.00] Games: 38352 W: 9969 L: 9883 D: 18500 Ptnml(0-2): 158, 4204, 10372, 4278, 164
World	Reckless	subtree-iir	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 19858 W: 4978 L: 5068 D: 9812 Ptnml(0-2): 52, 2427, 5059, 2341, 50
World	Reckless	10-buckets	diff	8.0+0.08	LLR: 0.01 (-2.25, 2.89) [0.00, 3.00] Games: 20108 W: 5190 L: 5144 D: 9774 Ptnml(0-2): 66, 2439, 5014, 2453, 82
World	Reckless	qsearch-see-threshold	diff	8.0+0.08	LLR: -0.07 (-2.25, 2.89) [0.00, 3.00] Games: 17068 W: 4302 L: 4269 D: 8497 Ptnml(0-2): 41, 2015, 4389, 2048, 41
World	Reckless	subtree-depth-1	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 71926 W: 18023 L: 18000 D: 35903 Ptnml(0-2): 115, 7562, 20605, 7547, 134
World	Reckless	main	diff	8.0+0.08	Elo: -2.87 +- 1.76 (95%) [N=40000] Games: 33918 W: 8357 L: 8637 D: 16924 Ptnml(0-2): 65, 3718, 9667, 3450, 59	MoveOverhead=100, adj. off
World	Reckless	pruning-depth-1	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 24280 W: 6096 L: 6176 D: 12008 Ptnml(0-2): 60, 2917, 6258, 2853, 52
World	Reckless	lmp-spsa	diff	8.0+0.08	Tuning 10 Parameters 12531/15000 Iterations 25062/30000 Games Played	stc first
World	Reckless	pruning-depth-take2	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 18116 W: 4552 L: 4651 D: 8913 Ptnml(0-2): 44, 2236, 4599, 2133, 46
World	Reckless	main	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [-3.00, 0.00] Games: 12806 W: 3124 L: 3284 D: 6398 Ptnml(0-2): 22, 1475, 3574, 1305, 27	MoveOverhead=250, adj. off
World	Reckless	12-buckets	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 26384 W: 6822 L: 6902 D: 12660 Ptnml(0-2): 125, 3203, 6587, 3181, 96	12-buckets vs. 10-buckets
World	Reckless	10-buckets	diff	40.0+0.40	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 44148 W: 11146 L: 10886 D: 22116 Ptnml(0-2): 33, 5079, 11589, 5341, 32
World	Reckless	12-buckets	diff	40.0+0.40	LLR: 0.32 (-2.25, 2.89) [0.00, 3.00] Games: 6310 W: 1568 L: 1536 D: 3206 Ptnml(0-2): 5, 741, 1633, 769, 7
World	Reckless	12-buckets	diff	N=25000	Elo: 10.27 +- 2.26 (95%) [N=40000] Games: 41132 W: 13650 L: 12434 D: 15048 Ptnml(0-2): 1047, 4349, 8765, 5151, 1254
World	Reckless	10-buckets	diff	N=25000	Elo: 9.77 +- 2.28 (95%) [N=40000] Games: 40168 W: 13323 L: 12194 D: 14651 Ptnml(0-2): 976, 4313, 8644, 4908, 1243
World	Reckless	fds-no-hs	diff	8.0+0.08	LLR: -0.46 (-2.25, 2.89) [-3.00, 0.00] Games: 113638 W: 28430 L: 28707 D: 56501 Ptnml(0-2): 257, 13862, 28855, 13591, 254
World	Reckless	simplify-post-lmr	diff	8.0+0.08	LLR: 2.96 (-2.25, 2.89) [-3.00, 0.00] Games: 43748 W: 11014 L: 10936 D: 21798 Ptnml(0-2): 81, 5229, 11200, 5259, 105
World	Reckless	initial-depth-after-hindsight	diff	8.0+0.08	LLR: -0.68 (-2.25, 2.89) [0.00, 3.00] Games: 26528 W: 6654 L: 6636 D: 13238 Ptnml(0-2): 53, 3205, 6735, 3213, 58

1 2 3 40 41 42 43 44 192 193 194