OpenBench

OpenBench Testing Framework

Finished
World	Reckless	strict-hs	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 22550 W: 5583 L: 5374 D: 11593 Ptnml(0-2): 10, 2468, 6111, 2675, 11
World	Reckless	rfp-adaptive-improvement	diff	8.0+0.08	LLR: -1.95 (-2.25, 2.89) [0.00, 3.00] Games: 18366 W: 4576 L: 4651 D: 9139 Ptnml(0-2): 58, 2223, 4701, 2138, 63
World	Reckless	lmp-eval-beta-improvement	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 59302 W: 14807 L: 14813 D: 29682 Ptnml(0-2): 162, 7105, 15144, 7057, 183
World	Reckless	styx-expt-6	diff	N=25000	Elo: 1.37 +- 2.04 (95%) [N=40000] Games: 40508 W: 11549 L: 11389 D: 17570 Ptnml(0-2): 598, 4824, 9294, 4896, 642
World	Reckless	strict-hs	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 55626 W: 14026 L: 13734 D: 27866 Ptnml(0-2): 137, 6471, 14307, 6759, 139
World	Reckless	nodes-tm-min	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 67522 W: 17008 L: 16694 D: 33820 Ptnml(0-2): 170, 7562, 18019, 7804, 206
World	Reckless	aw-simpl	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-3.00, 0.00] Games: 15160 W: 3706 L: 3577 D: 7877 Ptnml(0-2): 5, 1646, 4151, 1771, 7
World	Reckless	lmp-expt	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 12598 W: 3138 L: 2950 D: 6510 Ptnml(0-2): 3, 1359, 3389, 1543, 5
World	Reckless	simplify-hs-fds	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-3.00, 0.00] Games: 15630 W: 3868 L: 3740 D: 8022 Ptnml(0-2): 4, 1714, 4249, 1846, 2
World	Reckless	styx-expt-5	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 46408 W: 11773 L: 11808 D: 22827 Ptnml(0-2): 159, 5605, 11723, 5546, 171
World	Reckless	styx-expt-5	diff	N=25000	Elo: -0.96 +- 2.05 (95%) [N=40000] Games: 40596 W: 11469 L: 11581 D: 17546 Ptnml(0-2): 620, 5022, 9138, 4886, 632
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 18970 W: 4874 L: 4660 D: 9436 Ptnml(0-2): 52, 2159, 4866, 2339, 69	take 3
World	Reckless	simplify-hs-fds	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [-2.75, 0.25] Games: 58266 W: 14704 L: 14640 D: 28922 Ptnml(0-2): 145, 6916, 14948, 6978, 146
World	Reckless	expt-51	diff	8.0+0.08	LLR: -1.04 (-2.25, 2.89) [0.00, 3.00] Games: 12692 W: 3158 L: 3192 D: 6342 Ptnml(0-2): 48, 1517, 3241, 1501, 39
World	Reckless	expt-51	diff	N=25000	Elo: -0.06 +- 2.05 (95%) [N=40000] Games: 40198 W: 11543 L: 11550 D: 17105 Ptnml(0-2): 620, 4849, 9199, 4780, 651
World	Reckless	aw-simpl	diff	8.0+0.08	LLR: 2.99 (-2.25, 2.89) [-2.75, 0.25] Games: 17004 W: 4304 L: 4158 D: 8542 Ptnml(0-2): 52, 1941, 4373, 2081, 55
World	Reckless	multipv-delta-2	diff	8.0+0.08	LLR: -2.14 (-2.25, 2.89) [0.00, 3.00] Games: 3920 W: 1040 L: 1172 D: 1708 Ptnml(0-2): 52, 522, 924, 430, 32	[MultiPV=2]
World	Reckless	multipv-delta	diff	D=14	LLR: 0.94 (-2.25, 2.89) [0.00, 3.00] Games: 3768 W: 998 L: 932 D: 1838 Ptnml(0-2): 21, 409, 956, 479, 19	[MultiPV=2]
World	Reckless	multipv-delta	diff	8.0+0.08	LLR: -1.61 (-2.25, 2.89) [0.00, 3.00] Games: 1024 W: 237 L: 348 D: 439 Ptnml(0-2): 22, 169, 226, 88, 7	[MultiPV=2]
World	Reckless	see-ordering-in-check	diff	8.0+0.08	LLR: -1.60 (-2.25, 2.89) [0.00, 3.00] Games: 15136 W: 3736 L: 3797 D: 7603 Ptnml(0-2): 40, 1843, 3849, 1810, 26
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: -1.53 (-2.25, 2.89) [0.00, 3.00] Games: 14552 W: 3622 L: 3680 D: 7250 Ptnml(0-2): 32, 1766, 3742, 1700, 36
World	Reckless	tm-spsa-expt-3	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 7492 W: 1786 L: 1900 D: 3806 Ptnml(0-2): 24, 896, 2004, 814, 8
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	LLR: -1.41 (-2.25, 2.89) [0.00, 3.00] Games: 8066 W: 1925 L: 1985 D: 4156 Ptnml(0-2): 0, 911, 2272, 849, 1
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	Tuning 19 Parameters 10011/10000 Iterations 40044/40000 Games Played	start from 'tm-spsa-expt' with soft/hard scales included
World	Reckless	tm-spsa-expt	diff	40.0+0.40	LLR: -0.00 (-2.25, 2.89) [0.00, 3.00] Games: 109452 W: 26779 L: 26560 D: 56113 Ptnml(0-2): 57, 11447, 31479, 11706, 37

1 2 3 40 41 42 43 44 269 270 271