OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	expt-07-finetuning	diff	N=25000	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 14962 W: 5083 L: 5231 D: 4648 Ptnml(0-2): 646, 1600, 3072, 1582, 581
Peregr	Peregrine	scaleDiff	diff	10.0+0.10	LLR: -0.67 (-2.25, 2.89) [0.00, 3.00] Games: 2756 W: 644 L: 680 D: 1432 Ptnml(0-2): 18, 362, 657, 320, 21
World	Peregrine	mat-scale-pawns	diff	10.0+0.10	LLR: -0.57 (-2.25, 2.89) [0.00, 3.00] Games: 2278 W: 548 L: 579 D: 1151 Ptnml(0-2): 13, 305, 539, 264, 18
World	Peregrine	prefetch-eariler	diff	6.0+0.06	LLR: -0.27 (-2.25, 2.89) [0.00, 3.00] Games: 6080 W: 1529 L: 1532 D: 3019 Ptnml(0-2): 47, 740, 1469, 737, 47
Peregr	Peregrine	ttPv1	diff	10.0+0.10	LLR: -0.74 (-2.25, 2.89) [0.00, 3.00] Games: 6416 W: 1549 L: 1581 D: 3286 Ptnml(0-2): 41, 812, 1532, 784, 39
World	Peregrine	spsa10	diff	10.0+0.10	Tuning 89 Parameters 4108/7500 Iterations 65732/120000 Games Played
World	Peregrine	spsa10-50k	diff	10.0+0.10	LLR: 0.26 (-2.25, 2.89) [0.00, 3.00] Games: 27782 W: 6862 L: 6781 D: 14139 Ptnml(0-2): 167, 3365, 6727, 3484, 148
Peregr	Peregrine	repetitionDetectionQs	diff	10.0+0.10	LLR: 0.05 (-2.25, 2.89) [0.00, 3.00] Games: 52594 W: 13020 L: 12895 D: 26679 Ptnml(0-2): 280, 6383, 12881, 6438, 315
Peregr	Peregrine	rfp-failtard	diff	10.0+0.10	LLR: 0.12 (-2.25, 2.89) [0.00, 3.00] Games: 65820 W: 16339 L: 16177 D: 33304 Ptnml(0-2): 417, 7944, 16028, 8102, 419
World	Peregrine	expt-06-finetuning-raw	diff	10.0+0.10	Elo: -1.39 +- 3.82 (95%) [N=40000] Games: 9724 W: 2430 L: 2469 D: 4825 Ptnml(0-2): 67, 1227, 2324, 1166, 78
Peregr	Peregrine	threats2	diff	10.0+0.10	LLR: -0.95 (-2.25, 2.89) [0.00, 3.00] Games: 27714 W: 6869 L: 6864 D: 13981 Ptnml(0-2): 150, 3368, 6841, 3323, 175
World	Peregrine	expt-06-finetuning-raw	diff	N=25000	LLR: -1.29 (-2.25, 2.89) [0.00, 3.00] Games: 5622 W: 1856 L: 1948 D: 1818 Ptnml(0-2): 251, 606, 1155, 582, 217
World	Peregrine	expt-06-finetuning	diff	10.0+0.10	LLR: -1.08 (-2.25, 2.89) [0.00, 3.00] Games: 3014 W: 745 L: 809 D: 1460 Ptnml(0-2): 35, 394, 700, 356, 22
World	Peregrine	expt-06-finetuning	diff	N=25000	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 5740 W: 1848 L: 2027 D: 1865 Ptnml(0-2): 265, 656, 1137, 617, 195
World	Peregrine	baseline-round	diff	10.0+0.10	LLR: -0.48 (-2.25, 2.89) [0.00, 3.00] Games: 3240 W: 792 L: 815 D: 1633 Ptnml(0-2): 26, 398, 791, 383, 22
World	Peregrine	baseline-soft-trunc	diff	10.0+0.10	LLR: -0.69 (-2.25, 2.89) [0.00, 3.00] Games: 3904 W: 964 L: 998 D: 1942 Ptnml(0-2): 26, 476, 984, 438, 28
Peregr	Peregrine	fds-r2	diff	10.0+0.10	LLR: -0.33 (-2.25, 2.89) [0.00, 3.00] Games: 6288 W: 1510 L: 1516 D: 3262 Ptnml(0-2): 32, 786, 1525, 758, 43
Peregr	Peregrine	fds-r	diff	10.0+0.10	LLR: -0.43 (-2.25, 2.89) [0.00, 3.00] Games: 6400 W: 1572 L: 1584 D: 3244 Ptnml(0-2): 39, 771, 1602, 739, 49
Peregr	Peregrine	simplLMR	diff	10.0+0.10	LLR: -0.60 (-2.25, 2.89) [-3.00, 0.00] Games: 11282 W: 2797 L: 2862 D: 5623 Ptnml(0-2): 89, 1392, 2728, 1359, 73
Peregr	Peregrine	simplLMR2	diff	10.0+0.10	LLR: -1.24 (-2.25, 2.89) [-3.00, 0.00] Games: 3718 W: 889 L: 975 D: 1854 Ptnml(0-2): 26, 488, 910, 416, 19
Peregr	Peregrine	threats4	diff	10.0+0.10	LLR: -1.85 (-2.25, 2.89) [0.00, 3.00] Games: 1154 W: 237 L: 359 D: 558 Ptnml(0-2): 17, 202, 248, 106, 4
Peregr	Peregrine	threats3	diff	10.0+0.10	LLR: -0.47 (-2.25, 2.89) [0.00, 3.00] Games: 548 W: 126 L: 153 D: 269 Ptnml(0-2): 6, 70, 144, 53, 1
Peregr	Peregrine	threats	diff	10.0+0.10	LLR: -1.22 (-2.25, 2.89) [0.00, 3.00] Games: 7196 W: 1764 L: 1823 D: 3609 Ptnml(0-2): 39, 905, 1774, 836, 44
Peregr	Peregrine	qsExtend	diff	10.0+0.10	LLR: -0.61 (-2.25, 2.89) [0.00, 3.00] Games: 9882 W: 2408 L: 2423 D: 5051 Ptnml(0-2): 54, 1219, 2418, 1188, 62
Peregr	Peregrine	repetitionDetection	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 29566 W: 7419 L: 7169 D: 14978 Ptnml(0-2): 172, 3469, 7272, 3677, 193

1 2 3 404 405 406 407 408 451 452 453