OpenBench

OpenBench Testing Framework

Finished
Peregr	Reckless	fix-see-in-check	diff	8.0+0.08	LLR: 2.97 (-2.25, 2.89) [0.00, 3.00] Games: 26710 W: 6846 L: 6608 D: 13256 Ptnml(0-2): 87, 3112, 6732, 3324, 100	(not fix)
Sapher	Reckless	cutoff-reduction	diff	8.0+0.08	LLR: 2.94 (-2.25, 2.89) [0.00, 3.00] Games: 65894 W: 16691 L: 16369 D: 32834 Ptnml(0-2): 195, 7723, 16864, 7895, 270	Take 1
87	Reckless	keys-refactor2	diff	8.0+0.08	LLR: 3.03 (-2.25, 2.89) [-2.75, 0.25] Games: 39288 W: 10042 L: 9937 D: 19309 Ptnml(0-2): 140, 4309, 10663, 4370, 162
World	Reckless	simplify-lmr-improvement	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [-2.75, 0.25] Games: 38392 W: 9769 L: 9668 D: 18955 Ptnml(0-2): 105, 4541, 9800, 4648, 102
Proton	Reckless	ps_movegen127	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [-2.75, 0.25] Games: 6600 W: 1756 L: 1604 D: 3240 Ptnml(0-2): 11, 645, 1850, 769, 25	simplify movegen.
Proton	Reckless	ps_movegen126	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [-2.75, 0.25] Games: 22516 W: 5840 L: 5715 D: 10961 Ptnml(0-2): 54, 2432, 6177, 2525, 70	Merge branch 'main' into ps_movegen126
Proton	Reckless	ps_movegen125	diff	8.0+0.08	LLR: 3.02 (-2.25, 2.89) [-2.75, 0.25] Games: 16506 W: 4269 L: 4125 D: 8112 Ptnml(0-2): 54, 1750, 4496, 1904, 49	simplify pawn captures.
Sapher	Reckless	simplify-bounded-tt	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-2.75, 0.25] Games: 47028 W: 11750 L: 11670 D: 23608 Ptnml(0-2): 28, 5324, 12731, 5402, 29	Take 1
Proton	Reckless	ps_threshold102	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [-2.75, 0.25] Games: 50608 W: 12769 L: 12689 D: 25150 Ptnml(0-2): 172, 5977, 12921, 6067, 167	simplify threshold.
Sapher	Reckless	simplify-bounded-tt	diff	8.0+0.08	LLR: 3.00 (-2.25, 2.89) [-2.75, 0.25] Games: 134776 W: 34057 L: 34128 D: 66591 Ptnml(0-2): 466, 16075, 34340, 16078, 429	Take 1
World	Reckless	datagen-12	diff	N=6000 *	Elo: 7.78 +- 2.06 (95%) [N=40000] Games: 40028 W: 14738 L: 13842 D: 11448 Ptnml(0-2): 755, 3660, 10480, 4172, 947	6k SN datagen-12 vs. 5k SN datagen-11
Sapher	Reckless	scaled-malus	diff	40.0+0.40	LLR: 2.96 (-2.25, 2.89) [0.00, 3.00] Games: 12682 W: 3185 L: 2996 D: 6501 Ptnml(0-2): 1, 1329, 3500, 1502, 9	Take 2.2 LTC
Sapher	Reckless	scaled-malus	diff	8.0+0.08	LLR: 2.98 (-2.25, 2.89) [0.00, 3.00] Games: 15778 W: 4085 L: 3873 D: 7820 Ptnml(0-2): 49, 1759, 4072, 1949, 60	Take 2.2
Sapher	Reckless	scaled-malus	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 33430 W: 8619 L: 8371 D: 16440 Ptnml(0-2): 123, 3811, 8584, 4089, 108	Take 2.1
Sapher	Reckless	scaled-malus	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 13706 W: 3527 L: 3325 D: 6854 Ptnml(0-2): 33, 1544, 3508, 1724, 44	Take 1
World	Reckless	fullmove-counter	diff	8.0+0.08	LLR: 2.95 (-2.25, 2.89) [-2.75, 0.25] Games: 27206 W: 7005 L: 6880 D: 13321 Ptnml(0-2): 115, 3031, 7195, 3138, 124	sanity check
Proton	Reckless	ps_drawbymaterial100	diff	8.0+0.08	LLR: 3.18 (-2.25, 2.89) [-2.75, 0.25] Games: 85740 W: 21929 L: 21898 D: 41913 Ptnml(0-2): 430, 9964, 22047, 10003, 426	Scale back draw_by_material.
87	Reckless	nmp-tt-rationalize-bound	diff	8.0+0.08	LLR: 2.91 (-2.25, 2.89) [-2.75, 0.25] Games: 89986 W: 22940 L: 22933 D: 44113 Ptnml(0-2): 384, 10256, 23658, 10359, 336	compare against upperbound instead of lowerbound zws score
Eren	Reckless	ldse	diff	40.0+0.40	LLR: 2.99 (-2.25, 2.89) [0.00, 3.00] Games: 157644 W: 39292 L: 38799 D: 79553 Ptnml(0-2): 74, 17615, 42963, 18084, 86	[SPEC] LTC scaling check
World	Reckless	quiet-buckets-as-indices-2	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-2.75, 0.25] Games: 94916 W: 23415 L: 23418 D: 48083 Ptnml(0-2): 60, 10778, 25774, 10797, 49	[SPEC]
87	Reckless	nmp-tt-thing3	diff	40.0+0.40	LLR: 2.95 (-2.25, 2.89) [0.00, 3.00] Games: 58740 W: 14662 L: 14381 D: 29697 Ptnml(0-2): 37, 6263, 16482, 6558, 30
World	Reckless	disable-syzygy	diff	8.0+0.08	Elo: 0.90 +- 2.03 (95%) [N=20000] Games: 20002 W: 5234 L: 5182 D: 9586 Ptnml(0-2): 2, 1743, 6461, 1791, 4	[Elo estimation] TBs, adj. off, Endgames_cdb.epd
Proton	Reckless	ps_pawnoffense103	diff	40.0+0.40	LLR: 3.06 (-2.25, 2.89) [0.00, 3.00] Games: 44726 W: 11146 L: 10884 D: 22696 Ptnml(0-2): 21, 4908, 12243, 5170, 21	Merge branch 'main' into ps_pawnoffense103
87	Reckless	nmp-tt-thing3	diff	8.0+0.08	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 36348 W: 9282 L: 9036 D: 18030 Ptnml(0-2): 104, 3990, 9753, 4210, 117
Proton	Reckless	ps_pawnoffense101	diff	8.0+0.08	LLR: 2.95 (-2.25, 2.89) [0.00, 3.00] Games: 118128 W: 30021 L: 29587 D: 58520 Ptnml(0-2): 331, 13792, 30385, 14224, 332	pawn offense includes advanced moves.

1 2 3 4 5 85 86 87