OpenBench

OpenBench Testing Framework

Finished
World	Reckless	gp-4	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 18464 W: 4608 L: 4697 D: 9159 Ptnml(0-2): 43, 2106, 5004, 2055, 24
World	Reckless	gp-3	diff	8.0+0.08	LLR: -1.25 (-2.25, 2.89) [0.00, 3.00] Games: 6386 W: 1570 L: 1629 D: 3187 Ptnml(0-2): 20, 773, 1660, 726, 14
Peregr	Reckless	mvv-threatened	diff	40.0+0.40	LLR: -0.25 (-2.25, 2.89) [0.00, 3.00] Games: 46278 W: 11380 L: 11298 D: 23600 Ptnml(0-2): 12, 5235, 12559, 5325, 8
Peregr	Reckless	multi-cut-ctf-cnt	diff	8.0+0.08	LLR: -1.45 (-2.25, 2.89) [0.00, 3.00] Games: 201586 W: 50742 L: 50388 D: 100456 Ptnml(0-2): 405, 23867, 51870, 24271, 380
Peregr	Reckless	force-pvs-write	diff	8.0+0.08	LLR: 2.93 (-2.25, 2.89) [0.00, 3.00] Games: 52432 W: 13427 L: 13140 D: 25865 Ptnml(0-2): 104, 6195, 13330, 6484, 103
Peregr	Reckless	hs-cutoff-cnt	diff	8.0+0.08	LLR: -0.36 (-2.25, 2.89) [0.00, 3.00] Games: 4672 W: 1172 L: 1183 D: 2317 Ptnml(0-2): 12, 585, 1159, 562, 18	apply cutoff_cnt reduction with hindisght
Peregr	Reckless	exact-static-eval	diff	8.0+0.08	LLR: -2.35 (-2.25, 2.89) [0.00, 3.00] Games: 18452 W: 4573 L: 4671 D: 9208 Ptnml(0-2): 40, 2271, 4698, 2181, 36
World	Reckless	gp-1	diff	8.0+0.08	LLR: -1.79 (-2.25, 2.89) [0.00, 3.00] Games: 16498 W: 4157 L: 4225 D: 8116 Ptnml(0-2): 37, 1956, 4330, 1890, 36
Peregr	Reckless	multi-cut-corrhist	diff	8.0+0.08	LLR: -2.13 (-2.25, 2.89) [0.00, 3.00] Games: 24704 W: 6145 L: 6216 D: 12343 Ptnml(0-2): 55, 2984, 6332, 2939, 42
World	Reckless	trust-nnue	diff	40.0+0.40	LLR: -2.27 (-2.25, 2.89) [-3.00, 0.00] Games: 13816 W: 3277 L: 3432 D: 7107 Ptnml(0-2): 2, 1669, 3720, 1516, 1
World	Reckless	trust-nnue	diff	8.0+0.08	LLR: -0.80 (-2.25, 2.89) [-2.75, 0.25] Games: 6786 W: 1651 L: 1710 D: 3425 Ptnml(0-2): 14, 841, 1740, 786, 12
World	Reckless	trust-search	diff	8.0+0.08	LLR: -2.42 (-2.25, 2.89) [-2.75, 0.25] Games: 2010 W: 428 L: 579 D: 1003 Ptnml(0-2): 9, 322, 488, 183, 3
World	Reckless	see-pruning-cutnode	diff	8.0+0.08	LLR: -1.52 (-2.25, 2.89) [0.00, 3.00] Games: 21076 W: 5241 L: 5284 D: 10551 Ptnml(0-2): 54, 2501, 5449, 2502, 32
World	Reckless	spsa-10-300k	diff	40.0+0.40	LLR: -1.57 (-2.25, 2.89) [0.00, 3.00] Games: 36766 W: 9008 L: 9019 D: 18739 Ptnml(0-2): 6, 4279, 9833, 4250, 15
World	Reckless	total-time	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 3564 W: 839 L: 958 D: 1767 Ptnml(0-2): 8, 442, 998, 329, 5
World	Reckless	batch-size	diff	8.0+0.08	LLR: -2.09 (-2.25, 2.89) [0.00, 3.00] Games: 14628 W: 3678 L: 3770 D: 7180 Ptnml(0-2): 39, 1813, 3702, 1721, 39
World	Reckless	batch-size	diff	N=25000	Elo: 1.00 +- 2.32 (95%) [N=40000] Games: 40320 W: 12904 L: 12788 D: 14628 Ptnml(0-2): 1173, 4572, 8634, 4528, 1253
World	Reckless	smp-tt-move-history	diff	5.0+0.05	LLR: -2.06 (-2.25, 2.89) [0.00, 4.00] Games: 4324 W: 1057 L: 1132 D: 2135 Ptnml(0-2): 4, 533, 1162, 460, 3
World	Reckless	smp-optimal-move	diff	5.0+0.05	LLR: -2.27 (-2.25, 2.89) [0.00, 4.00] Games: 1332 W: 293 L: 388 D: 651 Ptnml(0-2): 7, 198, 344, 117, 0
World	Reckless	multicut-non-ttpv	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 13218 W: 3230 L: 3334 D: 6654 Ptnml(0-2): 32, 1628, 3394, 1522, 33
World	Reckless	spsa-10	diff	40.0+0.40	Tuning 141 Parameters 18774/25000 Iterations 300392/400000 Games Played
World	Reckless	remove-ob-add-obs-s3	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 76372 W: 19619 L: 19584 D: 37169 Ptnml(0-2): 254, 9257, 19126, 9298, 251
Peregr	Reckless	qs-noisy-hist	diff	8.0+0.08	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 22230 W: 5541 L: 5627 D: 11062 Ptnml(0-2): 44, 2710, 5688, 2634, 39
Peregr	Reckless	qs-noisy-hist2	diff	8.0+0.08	LLR: -1.18 (-2.25, 2.89) [0.00, 3.00] Games: 1582 W: 361 L: 428 D: 793 Ptnml(0-2): 6, 226, 390, 167, 2	just checking
World	Reckless	remove-ob-add-obs-s3	diff	N=25000	Elo: 1.27 +- 2.32 (95%) [N=40000] Games: 40318 W: 12910 L: 12763 D: 14645 Ptnml(0-2): 1187, 4551, 8570, 4630, 1221

1 2 3 7 8 9 10 11 272 273 274