OpenBench

OpenBench Testing Framework

Finished
World	Reckless	nmp-red-improvement	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 11248 W: 2714 L: 2823 D: 5711 Ptnml(0-2): 26, 1406, 2872, 1291, 29
World	Reckless	rfp-adaptive-1	diff	8.0+0.08	LLR: -2.34 (-2.25, 2.89) [0.00, 3.00] Games: 8842 W: 2132 L: 2250 D: 4460 Ptnml(0-2): 21, 1114, 2261, 1012, 13	take 2
World	Reckless	styx-expt-7	diff	8.0+0.08	LLR: -2.39 (-2.25, 2.89) [0.00, 3.00] Games: 12986 W: 3180 L: 3295 D: 6511 Ptnml(0-2): 43, 1650, 3218, 1543, 39
World	Reckless	styx-expt-7	diff	N=25000	Elo: -1.79 +- 2.04 (95%) [N=40000] Games: 40204 W: 11285 L: 11492 D: 17427 Ptnml(0-2): 599, 4940, 9239, 4717, 607
World	Reckless	nmp-ttpv	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [-2.75, 0.25] Games: 159948 W: 39746 L: 40175 D: 80027 Ptnml(0-2): 448, 19198, 41106, 18779, 443
World	Reckless	qs-adaptive-lmp	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 46710 W: 11563 L: 11593 D: 23554 Ptnml(0-2): 125, 5500, 12105, 5530, 95
World	Reckless	rfp-adaptive-1	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 10066 W: 2476 L: 2587 D: 5003 Ptnml(0-2): 37, 1217, 2625, 1128, 26
World	Reckless	nodes-tm-min	diff	40.0+0.40	LLR: -0.78 (-2.25, 2.89) [0.00, 3.00] Games: 3710 W: 874 L: 908 D: 1928 Ptnml(0-2): 1, 404, 1078, 372, 0
World	Reckless	hindsight-lmr-check	diff	8.0+0.08	LLR: -2.19 (-2.25, 2.89) [0.00, 3.00] Games: 25428 W: 6385 L: 6458 D: 12585 Ptnml(0-2): 64, 3050, 6555, 2985, 60
World	Reckless	styx-expt-6	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 32034 W: 8055 L: 8119 D: 15860 Ptnml(0-2): 87, 3916, 8089, 3824, 101
World	Reckless	strict-hs	diff	40.0+0.40	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 22550 W: 5583 L: 5374 D: 11593 Ptnml(0-2): 10, 2468, 6111, 2675, 11
World	Reckless	rfp-adaptive-improvement	diff	8.0+0.08	LLR: -1.95 (-2.25, 2.89) [0.00, 3.00] Games: 18366 W: 4576 L: 4651 D: 9139 Ptnml(0-2): 58, 2223, 4701, 2138, 63
World	Reckless	lmp-eval-beta-improvement	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 59302 W: 14807 L: 14813 D: 29682 Ptnml(0-2): 162, 7105, 15144, 7057, 183
World	Reckless	styx-expt-6	diff	N=25000	Elo: 1.37 +- 2.04 (95%) [N=40000] Games: 40508 W: 11549 L: 11389 D: 17570 Ptnml(0-2): 598, 4824, 9294, 4896, 642
World	Reckless	strict-hs	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 55626 W: 14026 L: 13734 D: 27866 Ptnml(0-2): 137, 6471, 14307, 6759, 139
World	Reckless	nodes-tm-min	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 67522 W: 17008 L: 16694 D: 33820 Ptnml(0-2): 170, 7562, 18019, 7804, 206
World	Reckless	aw-simpl	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-3.00, 0.00] Games: 15160 W: 3706 L: 3577 D: 7877 Ptnml(0-2): 5, 1646, 4151, 1771, 7
World	Reckless	lmp-expt	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 12598 W: 3138 L: 2950 D: 6510 Ptnml(0-2): 3, 1359, 3389, 1543, 5
World	Reckless	simplify-hs-fds	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-3.00, 0.00] Games: 15630 W: 3868 L: 3740 D: 8022 Ptnml(0-2): 4, 1714, 4249, 1846, 2
World	Reckless	styx-expt-5	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 46408 W: 11773 L: 11808 D: 22827 Ptnml(0-2): 159, 5605, 11723, 5546, 171
World	Reckless	styx-expt-5	diff	N=25000	Elo: -0.96 +- 2.05 (95%) [N=40000] Games: 40596 W: 11469 L: 11581 D: 17546 Ptnml(0-2): 620, 5022, 9138, 4886, 632
World	Reckless	lmp-expt	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 18970 W: 4874 L: 4660 D: 9436 Ptnml(0-2): 52, 2159, 4866, 2339, 69	take 3
World	Reckless	simplify-hs-fds	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [-2.75, 0.25] Games: 58266 W: 14704 L: 14640 D: 28922 Ptnml(0-2): 145, 6916, 14948, 6978, 146
World	Reckless	expt-51	diff	8.0+0.08	LLR: -1.04 (-2.25, 2.89) [0.00, 3.00] Games: 12692 W: 3158 L: 3192 D: 6342 Ptnml(0-2): 48, 1517, 3241, 1501, 39
World	Reckless	expt-51	diff	N=25000	Elo: -0.06 +- 2.05 (95%) [N=40000] Games: 40198 W: 11543 L: 11550 D: 17105 Ptnml(0-2): 620, 4849, 9199, 4780, 651

1 2 3 6 7 8 9 10 236 237 238