OpenBench

OpenBench Testing Framework

Finished
World	Reckless	in-check-conthist	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 4.50] Games: 14440 W: 3387 L: 3431 D: 7622 Ptnml(0-2): 74, 1742, 3625, 1712, 67
World	Reckless	expt-018	diff	N=25000	LLR: -2.36 (-2.25, 2.89) [0.00, 4.50] Games: 36482 W: 10898 L: 10861 D: 14723 Ptnml(0-2): 1042, 4359, 7411, 4378, 1051
World	Reckless	qs-cutoff-tard	diff	8.0+0.08	LLR: -1.94 (-2.25, 2.89) [0.00, 3.50] Games: 5584 W: 1262 L: 1349 D: 2973 Ptnml(0-2): 31, 704, 1407, 621, 29
World	Reckless	in-check-current	diff	8.0+0.08	LLR: -1.07 (-2.25, 2.89) [0.00, 4.50] Games: 1080 W: 228 L: 268 D: 584 Ptnml(0-2): 4, 158, 254, 122, 2
World	Reckless	no-atomics	diff	8.0+0.08	LLR: -0.66 (-2.25, 2.89) [-5.00, 0.00] Games: 61584 W: 14482 L: 14723 D: 32379 Ptnml(0-2): 223, 6704, 17188, 6445, 232
World	Reckless	early-return	diff	8.0+0.08	LLR: -0.96 (-2.25, 2.89) [0.00, 4.50] Games: 3336 W: 789 L: 816 D: 1731 Ptnml(0-2): 17, 393, 870, 376, 12
World	Reckless	skip-see-good-noisy	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 4.50] Games: 10504 W: 2480 L: 2537 D: 5487 Ptnml(0-2): 59, 1263, 2646, 1244, 40
World	Reckless	tt-policy-tweak	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 4.50] Games: 21908 W: 5160 L: 5177 D: 11571 Ptnml(0-2): 102, 2660, 5458, 2621, 113
World	Reckless	qs-tt-save-in-check-depth	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 4.50] Games: 18390 W: 4236 L: 4266 D: 9888 Ptnml(0-2): 92, 2250, 4533, 2236, 84
World	Reckless	lmr-confidence	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 4.50] Games: 16736 W: 3954 L: 3989 D: 8793 Ptnml(0-2): 83, 2035, 4165, 2004, 81
World	Reckless	less-aggressive-fp	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 4.50] Games: 10652 W: 2477 L: 2534 D: 5641 Ptnml(0-2): 64, 1326, 2593, 1289, 54
World	Reckless	more-lmr	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 4.50] Games: 30796 W: 7458 L: 7445 D: 15893 Ptnml(0-2): 154, 3730, 7611, 3755, 148
World	Reckless	material-scaling-2	diff	8.0+0.08	LLR: 2.94 (-2.25, 2.89) [0.00, 4.50] Games: 31680 W: 7663 L: 7433 D: 16584 Ptnml(0-2): 150, 3768, 7783, 3980, 159
World	Reckless	see-qs	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 4.50] Games: 7754 W: 1820 L: 1887 D: 4047 Ptnml(0-2): 46, 975, 1897, 918, 41
World	Reckless	tt-clusters	diff	8.0+0.08	LLR: -2.29 (-2.25, 2.89) [0.00, 4.50] Games: 2676 W: 607 L: 695 D: 1374 Ptnml(0-2): 17, 381, 629, 295, 16
World	Reckless	nmp-guard	diff	8.0+0.08	LLR: 2.98 (-2.25, 2.89) [0.00, 4.50] Games: 98646 W: 23697 L: 23237 D: 51712 Ptnml(0-2): 499, 11625, 24594, 12127, 478
World	Reckless	v11-dad683ee	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 4.50] Games: 17824 W: 4359 L: 4391 D: 9074 Ptnml(0-2): 164, 2101, 4336, 2225, 86
World	Reckless	v11-dad683ee	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 4.50] Games: 6394 W: 1609 L: 1478 D: 3307 Ptnml(0-2): 17, 655, 1712, 806, 7
World	Reckless	v11-dad683ee	diff	N=25000	LLR: -2.27 (-2.25, 2.89) [0.00, 4.50] Games: 2870 W: 822 L: 930 D: 1118 Ptnml(0-2): 107, 354, 578, 332, 64
World	Reckless	see-qs	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 4.50] Games: 5268 W: 1212 L: 1288 D: 2768 Ptnml(0-2): 38, 663, 1302, 599, 32
World	Reckless	no-atomics-raw-eval	diff	8.0+0.08	LLR: -0.33 (-2.25, 2.89) [0.00, 4.50] Games: 11776 W: 2813 L: 2786 D: 6177 Ptnml(0-2): 57, 1401, 2949, 1420, 61
World	Reckless	optimism-2	diff	8.0+0.08	LLR: -2.14 (-2.25, 2.89) [0.00, 4.50] Games: 8576 W: 2017 L: 2075 D: 4484 Ptnml(0-2): 42, 1061, 2139, 1005, 41
World	Reckless	tt-policy-with-aging	diff	8.0+0.08	LLR: 2.97 (-2.25, 2.89) [0.00, 4.50] Games: 17496 W: 4318 L: 4136 D: 9042 Ptnml(0-2): 81, 2032, 4364, 2166, 105
World	Reckless	qs-see-threshold-mp	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 4.50] Games: 43854 W: 10756 L: 10485 D: 22613 Ptnml(0-2): 194, 5289, 10747, 5446, 251
World	Reckless	cuckoo-2	diff	8.0+0.08	LLR: 2.94 (-2.25, 2.89) [0.00, 4.50] Games: 18498 W: 4514 L: 4330 D: 9654 Ptnml(0-2): 58, 2234, 4527, 2326, 104

1 2 3 192 193 194 195 196 269 270 271