OpenBench

OpenBench Testing Framework

Finished
World	Reckless	hs-in-check	diff	40.0+0.40	LLR: -0.48 (-2.25, 2.89) [0.00, 3.00] Games: 18216 W: 4456 L: 4445 D: 9315 Ptnml(0-2): 7, 2081, 4931, 2072, 17
World	Reckless	ema-wdl-2	diff	8.0+0.08	LLR: -1.94 (-2.25, 2.89) [0.00, 3.00] Games: 23236 W: 5922 L: 5987 D: 11327 Ptnml(0-2): 85, 2858, 5807, 2773, 95
World	Reckless	ema-wdl-2	diff	N=25000	Elo: -0.03 +- 2.04 (95%) [N=40000] Games: 40546 W: 11588 L: 11592 D: 17366 Ptnml(0-2): 616, 4870, 9329, 4818, 640
World	Reckless	hs-in-check	diff	8.0+0.08	LLR: 2.95 (-2.25, 2.89) [0.00, 3.00] Games: 46528 W: 11867 L: 11591 D: 23070 Ptnml(0-2): 110, 5421, 11954, 5641, 138
World	Reckless	probcut-eval	diff	8.0+0.08	LLR: -2.77 (-2.25, 2.89) [0.00, 3.00] Games: 10828 W: 2649 L: 2788 D: 5391 Ptnml(0-2): 39, 1316, 2838, 1187, 34
World	Reckless	hs-quiet-moves	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 14304 W: 3579 L: 3683 D: 7042 Ptnml(0-2): 39, 1759, 3654, 1667, 33
World	Reckless	longer-warmup-higher-lr	diff	8.0+0.08	LLR: 0.60 (-2.25, 2.89) [0.00, 3.00] Games: 113990 W: 29142 L: 28850 D: 55998 Ptnml(0-2): 405, 13631, 28649, 13887, 423
World	Reckless	longer-warmup-higher-lr	diff	N=25000	Elo: 1.71 +- 2.05 (95%) [N=40000] Games: 40520 W: 11732 L: 11533 D: 17255 Ptnml(0-2): 630, 4790, 9245, 4941, 654
World	Reckless	simplify-quiet-updates	diff	40.0+0.40	LLR: 2.93 (-2.25, 2.89) [-2.75, 0.25] Games: 38984 W: 9686 L: 9591 D: 19707 Ptnml(0-2): 15, 4341, 10684, 4438, 14
World	Reckless	adamw-decay-0.005	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 8646 W: 2142 L: 2257 D: 4247 Ptnml(0-2): 23, 1075, 2252, 940, 33
World	Reckless	adamw-decay-0.005	diff	N=25000	Elo: -4.32 +- 2.03 (95%) [N=40000] Games: 40714 W: 11393 L: 11899 D: 17422 Ptnml(0-2): 659, 5053, 9355, 4715, 575
World	Reckless	nmp-unlimited	diff	8.0+0.08	LLR: -0.83 (-2.25, 2.89) [0.00, 3.00] Games: 16838 W: 4271 L: 4283 D: 8284 Ptnml(0-2): 53, 1926, 4465, 1930, 45
World	Reckless	simplify-quiet-updates	diff	8.0+0.08	LLR: 3.05 (-2.25, 2.89) [-2.75, 0.25] Games: 11110 W: 2934 L: 2774 D: 5402 Ptnml(0-2): 27, 1246, 2864, 1376, 42
World	Reckless	ema-wdl	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 15236 W: 3827 L: 3930 D: 7479 Ptnml(0-2): 53, 1905, 3819, 1774, 67
World	Reckless	ema-wdl	diff	N=25000	Elo: -0.53 +- 2.03 (95%) [N=40000] Games: 40712 W: 11683 L: 11745 D: 17284 Ptnml(0-2): 608, 4946, 9354, 4796, 652
World	Reckless	main	diff	8.0+0.08	LLR: -0.04 (-2.25, 2.89) [0.00, 3.00] Games: 58 W: 14 L: 16 D: 28 Ptnml(0-2): 0, 8, 15, 6, 0	test main - machine #435 works
World	Reckless	bnfp-correction-value	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 24852 W: 6249 L: 6337 D: 12266 Ptnml(0-2): 96, 3027, 6263, 2949, 91
World	Reckless	fds-alpha-raises	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 17558 W: 4348 L: 4437 D: 8773 Ptnml(0-2): 47, 1882, 5004, 1805, 41
World	Reckless	ema	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 21078 W: 5383 L: 5475 D: 10220 Ptnml(0-2): 99, 2597, 5250, 2483, 110
World	Reckless	ema	diff	N=25000	Elo: 0.63 +- 2.05 (95%) [N=40000] Games: 40070 W: 11461 L: 11388 D: 17221 Ptnml(0-2): 582, 4833, 9186, 4798, 636
World	Reckless	pessimistic-optimism	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 42412 W: 10594 L: 10642 D: 21176 Ptnml(0-2): 134, 5098, 10793, 5044, 137
World	Reckless	fp-correction-value	diff	40.0+0.40	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 18418 W: 4561 L: 4361 D: 9496 Ptnml(0-2): 8, 1982, 5028, 2184, 7
World	Reckless	fp-correction-value	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 57166 W: 14435 L: 14137 D: 28594 Ptnml(0-2): 163, 6658, 14658, 6926, 178
World	Reckless	corrhist3	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 14480 W: 3595 L: 3699 D: 7186 Ptnml(0-2): 47, 1764, 3706, 1692, 31
World	Reckless	trust-eval	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [-2.75, 0.25] Games: 156298 W: 39172 L: 39594 D: 77532 Ptnml(0-2): 446, 18835, 40052, 18327, 489

1 2 3 13 14 15 16 17 269 270 271