OpenBench

OpenBench Testing Framework

Finished
World	Reckless	remove-rfs	diff	8.0+0.08	LLR: 3.03 (-2.25, 2.89) [-2.75, 0.25] Games: 35672 W: 9037 L: 8922 D: 17713 Ptnml(0-2): 116, 4232, 9044, 4309, 135
World	Reckless	adv-09	diff	N=25000	Elo: 0.31 +- 2.03 (95%) [N=40000] Games: 40056 W: 11333 L: 11297 D: 17426 Ptnml(0-2): 579, 4831, 9152, 4907, 559
World	Reckless	adv-09	diff	8.0+0.08	LLR: -2.40 (-2.25, 2.89) [0.00, 3.00] Games: 6962 W: 1715 L: 1845 D: 3402 Ptnml(0-2): 26, 921, 1712, 801, 21
World	Reckless	main	diff	8.0+0.08	Elo: 7.03 +- 5.70 (95%) [N=40000] Games: 4006 W: 1066 L: 985 D: 1955 Ptnml(0-2): 25, 428, 1009, 523, 18	quick sanity check vs. v0.9.0
World	Reckless	lmp-is-direct-check-again	diff	40.0+0.40	LLR: 2.93 (-2.25, 2.89) [0.00, 3.00] Games: 6500 W: 1681 L: 1504 D: 3315 Ptnml(0-2): 2, 654, 1764, 825, 5
World	Reckless	lmp-is-direct-check-again	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 28536 W: 7260 L: 7027 D: 14249 Ptnml(0-2): 71, 3231, 7438, 3450, 78
World	Reckless	lmp-rework-2	diff	40.0+0.40	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 12190 W: 3033 L: 2846 D: 6311 Ptnml(0-2): 3, 1303, 3300, 1482, 7
World	Reckless	remove-rfs	diff	8.0+0.08	LLR: 0.33 (-2.25, 2.89) [0.00, 3.00] Games: 5606 W: 1431 L: 1399 D: 2776 Ptnml(0-2): 16, 663, 1416, 689, 19
World	Reckless	lmp-rework-2	diff	8.0+0.08	LLR: 3.11 (-2.25, 2.89) [0.00, 3.00] Games: 26016 W: 6663 L: 6421 D: 12932 Ptnml(0-2): 69, 3009, 6617, 3237, 76
World	Reckless	remove-rfs	diff	N=25000	Elo: -0.58 +- 2.00 (95%) [N=40000] Games: 40874 W: 11499 L: 11567 D: 17808 Ptnml(0-2): 603, 4882, 9482, 4920, 550
World	Reckless-AVX512	l2-32	diff	40.0+0.40	LLR: -0.33 (-2.25, 2.89) [0.00, 3.00] Games: 10410 W: 2566 L: 2563 D: 5281 Ptnml(0-2): 1, 1119, 2962, 1122, 1	[Threads=4 Hash=256]
World	Reckless	remove-ply-guard	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [-2.75, 0.25] Games: 45802 W: 11138 L: 11056 D: 23608 Ptnml(0-2): 14, 5089, 12611, 5175, 12
World	Reckless	[Stockfish] dev	diff	N=5000 *	Generated 20000150/20000000 Games Elo: -1.52 +- 0.12 (95%) [N=20000000] Games: 20000150 W: 6676972 L: 6764469 D: 6558709	[ADV-09] Reckless 5k SN vs. SF-dev 9.4k FN
World	Reckless	remove-ply-guard	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [-2.75, 0.25] Games: 45498 W: 11276 L: 11493 D: 22729 Ptnml(0-2): 122, 5414, 11874, 5237, 102
World	Reckless	sf-se-ply-margin	diff	40.0+0.40	LLR: -1.62 (-2.25, 2.89) [0.00, 3.00] Games: 6412 W: 1477 L: 1553 D: 3382 Ptnml(0-2): 2, 750, 1778, 674, 2	50% TP
World	Reckless	l2-32	diff	40.0+0.40	LLR: -2.36 (-2.25, 2.89) [0.00, 3.00] Games: 17854 W: 4323 L: 4419 D: 9112 Ptnml(0-2): 17, 2117, 4745, 2041, 7
World	Reckless	l2-32	diff	N=25000	Elo: 5.93 +- 2.03 (95%) [N=40000] Games: 40036 W: 11735 L: 11052 D: 17249 Ptnml(0-2): 543, 4535, 9283, 5010, 647
World	Reckless	l2-32	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 12696 W: 3151 L: 3261 D: 6284 Ptnml(0-2): 56, 1567, 3203, 1475, 47
World	Reckless	lmp-rework	diff	40.0+0.40	LLR: -1.48 (-2.25, 2.89) [0.00, 3.00] Games: 15282 W: 3691 L: 3741 D: 7850 Ptnml(0-2): 3, 1740, 4205, 1690, 3
World	Reckless	lmp-rework	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 67394 W: 16985 L: 16667 D: 33742 Ptnml(0-2): 153, 7891, 17322, 8147, 184
World	Reckless	probcut-threshold	diff	8.0+0.08	LLR: 0.25 (-2.25, 2.89) [0.00, 3.00] Games: 25344 W: 6315 L: 6245 D: 12784 Ptnml(0-2): 63, 2958, 6563, 3022, 66
World	Reckless	l2-32-wider	diff	5.0+0.05	LLR: -2.33 (-2.25, 2.89) [0.00, 4.00] Games: 10050 W: 2489 L: 2560 D: 5001 Ptnml(0-2): 12, 1202, 2667, 1133, 11	[Threads=8 Hash=256]
World	Reckless	l2-32-wider	diff	40.0+0.40	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 7780 W: 1874 L: 1986 D: 3920 Ptnml(0-2): 4, 971, 2053, 857, 5
World	Reckless	l2-32-wider-400	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 9134 W: 2321 L: 2442 D: 4371 Ptnml(0-2): 48, 1175, 2235, 1068, 41
World	Reckless	l2-32-wider-400	diff	N=25000	Elo: 2.89 +- 2.02 (95%) [N=40000] Games: 40540 W: 11649 L: 11312 D: 17579 Ptnml(0-2): 559, 4787, 9287, 5032, 605

1 2 3 25 26 27 28 29 269 270 271