OpenBench

OpenBench Testing Framework

Finished
World	Reckless	aw-simpl	diff	8.0+0.08	LLR: 2.99 (-2.25, 2.89) [-2.75, 0.25] Games: 17004 W: 4304 L: 4158 D: 8542 Ptnml(0-2): 52, 1941, 4373, 2081, 55
World	Reckless	multipv-delta-2	diff	8.0+0.08	LLR: -2.14 (-2.25, 2.89) [0.00, 3.00] Games: 3920 W: 1040 L: 1172 D: 1708 Ptnml(0-2): 52, 522, 924, 430, 32	[MultiPV=2]
World	Reckless	multipv-delta	diff	D=14	LLR: 0.94 (-2.25, 2.89) [0.00, 3.00] Games: 3768 W: 998 L: 932 D: 1838 Ptnml(0-2): 21, 409, 956, 479, 19	[MultiPV=2]
World	Reckless	multipv-delta	diff	8.0+0.08	LLR: -1.61 (-2.25, 2.89) [0.00, 3.00] Games: 1024 W: 237 L: 348 D: 439 Ptnml(0-2): 22, 169, 226, 88, 7	[MultiPV=2]
World	Reckless	see-ordering-in-check	diff	8.0+0.08	LLR: -1.60 (-2.25, 2.89) [0.00, 3.00] Games: 15136 W: 3736 L: 3797 D: 7603 Ptnml(0-2): 40, 1843, 3849, 1810, 26
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: -1.53 (-2.25, 2.89) [0.00, 3.00] Games: 14552 W: 3622 L: 3680 D: 7250 Ptnml(0-2): 32, 1766, 3742, 1700, 36
World	Reckless	tm-spsa-expt-3	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 7492 W: 1786 L: 1900 D: 3806 Ptnml(0-2): 24, 896, 2004, 814, 8
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	LLR: -1.41 (-2.25, 2.89) [0.00, 3.00] Games: 8066 W: 1925 L: 1985 D: 4156 Ptnml(0-2): 0, 911, 2272, 849, 1
World	Reckless	tm-spsa-expt-2	diff	40.0+0.40	Tuning 19 Parameters 10011/10000 Iterations 40044/40000 Games Played	start from 'tm-spsa-expt' with soft/hard scales included
World	Reckless	tm-spsa-expt	diff	40.0+0.40	LLR: -0.00 (-2.25, 2.89) [0.00, 3.00] Games: 109452 W: 26779 L: 26560 D: 56113 Ptnml(0-2): 57, 11447, 31479, 11706, 37
World	Reckless	expt-50	diff	4.0+0.04	LLR: -2.45 (-2.25, 2.89) [0.00, 3.00] Games: 30694 W: 8002 L: 8084 D: 14608 Ptnml(0-2): 200, 3765, 7498, 3685, 199
World	Reckless	expt-50	diff	N=25000	Elo: -3.89 +- 2.03 (95%) [N=40000] Games: 40084 W: 11196 L: 11645 D: 17243 Ptnml(0-2): 628, 4936, 9311, 4591, 576
World	Reckless	expt-49	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 18576 W: 4635 L: 4731 D: 9210 Ptnml(0-2): 76, 2254, 4708, 2190, 60
World	Reckless	expt-49	diff	N=25000	Elo: 2.48 +- 2.04 (95%) [N=40000] Games: 40164 W: 11591 L: 11304 D: 17269 Ptnml(0-2): 562, 4769, 9190, 4942, 619
World	Reckless	expt-48	diff	40.0+0.40	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 15728 W: 3798 L: 3892 D: 8038 Ptnml(0-2): 7, 1879, 4186, 1785, 7	L2=32, SP-style dual activation on L2
World	Reckless	expt-48	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 8246 W: 2031 L: 2154 D: 4061 Ptnml(0-2): 33, 1057, 2051, 964, 18	L2=32, SP-style dual activation on L2
World	Reckless	expt-48	diff	N=25000	Elo: 6.46 +- 2.03 (95%) [N=40000] Games: 40422 W: 11857 L: 11105 D: 17460 Ptnml(0-2): 561, 4573, 9272, 5163, 642	L2=32, SP-style dual activation on L2
World	Reckless	expt-47	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 23934 W: 6013 L: 6095 D: 11826 Ptnml(0-2): 75, 2939, 6020, 2859, 74
World	Reckless	expt-47	diff	N=25000	Elo: -1.11 +- 2.05 (95%) [N=40000] Games: 40052 W: 11353 L: 11481 D: 17218 Ptnml(0-2): 617, 4896, 9093, 4838, 582
World	Reckless	tm-spsa-expt	diff	40.0+0.40	Tuning 15 Parameters 10013/10000 Iterations 40052/40000 Games Played
World	Reckless	styx-expt-4	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 5432 W: 1285 L: 1411 D: 2736 Ptnml(0-2): 28, 710, 1348, 620, 10
World	Reckless	styx-expt-4	diff	N=25000	Elo: -12.79 +- 2.07 (95%) [N=40000] Games: 40360 W: 10832 L: 12317 D: 17211 Ptnml(0-2): 796, 5351, 9125, 4358, 550
World	Reckless	score-trend-4	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 37366 W: 9521 L: 9275 D: 18570 Ptnml(0-2): 80, 4115, 10061, 4333, 94
World	Reckless	score-trend-spsa	diff	40.0+0.40	Tuning 5 Parameters 2443/10000 Iterations 9772/40000 Games Played
World	Reckless	expt-46	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 27838 W: 7027 L: 7100 D: 13711 Ptnml(0-2): 105, 3371, 7036, 3306, 101

1 2 3 7 8 9 10 11 236 237 238