OpenBench

OpenBench Testing Framework

Finished
World	Reckless	lmp-expt	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 12598 W: 3138 L: 2950 D: 6510 Ptnml(0-2): 3, 1359, 3389, 1543, 5
World	Reckless	simplify-hs-fds	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-3.00, 0.00] Games: 15630 W: 3868 L: 3740 D: 8022 Ptnml(0-2): 4, 1714, 4249, 1846, 2
World	Reckless	styx-expt-5	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 46408 W: 11773 L: 11808 D: 22827 Ptnml(0-2): 159, 5605, 11723, 5546, 171
World	Reckless	styx-expt-5	diff	N=25000	Elo: -0.96 +- 2.05 (95%) [N=40000] Games: 40596 W: 11469 L: 11581 D: 17546 Ptnml(0-2): 620, 5022, 9138, 4886, 632
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 18970 W: 4874 L: 4660 D: 9436 Ptnml(0-2): 52, 2159, 4866, 2339, 69	take 3
World	Reckless	simplify-hs-fds	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [-2.75, 0.25] Games: 58266 W: 14704 L: 14640 D: 28922 Ptnml(0-2): 145, 6916, 14948, 6978, 146
World	Reckless	expt-51	diff	8.0+0.08	LLR: -1.04 (-2.25, 2.89) [0.00, 3.00] Games: 12692 W: 3158 L: 3192 D: 6342 Ptnml(0-2): 48, 1517, 3241, 1501, 39
World	Reckless	expt-51	diff	N=25000	Elo: -0.06 +- 2.05 (95%) [N=40000] Games: 40198 W: 11543 L: 11550 D: 17105 Ptnml(0-2): 620, 4849, 9199, 4780, 651
World	Reckless	aw-simpl	diff	8.0+0.08	LLR: 2.99 (-2.25, 2.89) [-2.75, 0.25] Games: 17004 W: 4304 L: 4158 D: 8542 Ptnml(0-2): 52, 1941, 4373, 2081, 55
87	Reckless	unexpected	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 18446 W: 4586 L: 4680 D: 9180 Ptnml(0-2): 50, 2233, 4742, 2157, 41	unexpected alpha raise extension
World	Reckless	multipv-delta-2	diff	8.0+0.08	LLR: -2.14 (-2.25, 2.89) [0.00, 3.00] Games: 3920 W: 1040 L: 1172 D: 1708 Ptnml(0-2): 52, 522, 924, 430, 32	[MultiPV=2]
World	Reckless	multipv-delta	diff	D=14	LLR: 0.94 (-2.25, 2.89) [0.00, 3.00] Games: 3768 W: 998 L: 932 D: 1838 Ptnml(0-2): 21, 409, 956, 479, 19	[MultiPV=2]
World	Reckless	multipv-delta	diff	8.0+0.08	LLR: -1.61 (-2.25, 2.89) [0.00, 3.00] Games: 1024 W: 237 L: 348 D: 439 Ptnml(0-2): 22, 169, 226, 88, 7	[MultiPV=2]
World	Reckless	see-ordering-in-check	diff	8.0+0.08	LLR: -1.60 (-2.25, 2.89) [0.00, 3.00] Games: 15136 W: 3736 L: 3797 D: 7603 Ptnml(0-2): 40, 1843, 3849, 1810, 26
Cj5716	Reckless	adapt-lmp-2	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 28318 W: 7051 L: 7126 D: 14141 Ptnml(0-2): 87, 3452, 7158, 3373, 89
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: -1.53 (-2.25, 2.89) [0.00, 3.00] Games: 14552 W: 3622 L: 3680 D: 7250 Ptnml(0-2): 32, 1766, 3742, 1700, 36
World	Reckless	tm-spsa-expt-3	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 7492 W: 1786 L: 1900 D: 3806 Ptnml(0-2): 24, 896, 2004, 814, 8
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	LLR: -1.41 (-2.25, 2.89) [0.00, 3.00] Games: 8066 W: 1925 L: 1985 D: 4156 Ptnml(0-2): 0, 911, 2272, 849, 1
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	Tuning 19 Parameters 10011/10000 Iterations 40044/40000 Games Played	start from 'tm-spsa-expt' with soft/hard scales included
World	Reckless	tm-spsa-expt	diff	40.0+0.40	LLR: -0.00 (-2.25, 2.89) [0.00, 3.00] Games: 109452 W: 26779 L: 26560 D: 56113 Ptnml(0-2): 57, 11447, 31479, 11706, 37
World	Reckless	expt-50	diff	4.0+0.04	LLR: -2.45 (-2.25, 2.89) [0.00, 3.00] Games: 30694 W: 8002 L: 8084 D: 14608 Ptnml(0-2): 200, 3765, 7498, 3685, 199
World	Reckless	expt-50	diff	N=25000	Elo: -3.89 +- 2.03 (95%) [N=40000] Games: 40084 W: 11196 L: 11645 D: 17243 Ptnml(0-2): 628, 4936, 9311, 4591, 576
87	Reckless	reduction-optimism	diff	40.0+0.40	LLR: 2.94 (-2.25, 2.89) [0.00, 3.00] Games: 74702 W: 18373 L: 18056 D: 38273 Ptnml(0-2): 22, 8289, 20415, 8600, 25
Cj5716	Reckless	adapt-lmp-3	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 34048 W: 8508 L: 8566 D: 16974 Ptnml(0-2): 84, 4084, 8736, 4046, 74
World	Reckless	expt-49	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 18576 W: 4635 L: 4731 D: 9210 Ptnml(0-2): 76, 2254, 4708, 2190, 60

1 2 3 77 78 79 80 81 409 410 411