OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	mtg-scale-2	diff	10.0+0.00	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 10206 W: 2668 L: 2450 D: 5088 Ptnml(0-2): 89, 1195, 2343, 1361, 115
World	Peregrine	log-time-in-sec	diff	10.0+0.10	LLR: -0.01 (-2.25, 2.89) [0.00, 3.00] Games: 2052 W: 500 L: 496 D: 1056 Ptnml(0-2): 17, 239, 505, 253, 12
World	Peregrine	mtg-scale	diff	10.0+0.10	LLR: -0.89 (-2.25, 2.89) [0.00, 3.00] Games: 3778 W: 872 L: 919 D: 1987 Ptnml(0-2): 27, 481, 915, 444, 22
World	Peregrine	expt-08-test77-78	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 654 W: 152 L: 210 D: 292 Ptnml(0-2): 14, 88, 171, 50, 4
World	Peregrine	iir-madness	diff	10.0+0.10	LLR: -0.52 (-2.25, 2.89) [0.00, 3.00] Games: 2890 W: 680 L: 705 D: 1505 Ptnml(0-2): 17, 353, 724, 340, 11
World	Peregrine	march-v3-arch	diff	6.0+0.06	LLR: 1.11 (-2.25, 2.89) [0.00, 3.00] Games: 22200 W: 5553 L: 5428 D: 11219 Ptnml(0-2): 190, 2647, 5282, 2810, 171
World	Peregrine	iir-madness	diff	10.0+0.10	LLR: -0.22 (-2.25, 2.89) [0.00, 3.00] Games: 10536 W: 2568 L: 2557 D: 5411 Ptnml(0-2): 63, 1302, 2525, 1317, 61
World	Peregrine	simplify-prev-bonus	diff	10.0+0.10	LLR: 0.05 (-2.25, 2.89) [-3.00, 0.00] Games: 29138 W: 7237 L: 7302 D: 14599 Ptnml(0-2): 183, 3594, 7075, 3539, 178
World	Peregrine	qs-lmp	diff	10.0+0.10	LLR: -0.68 (-2.25, 2.89) [0.00, 3.00] Games: 1668 W: 394 L: 431 D: 843 Ptnml(0-2): 4, 220, 426, 177, 7
World	Peregrine	lmr-madness	diff	10.0+0.10	LLR: -0.77 (-2.25, 2.89) [0.00, 3.00] Games: 4704 W: 1175 L: 1213 D: 2316 Ptnml(0-2): 39, 574, 1158, 548, 33
World	Peregrine	see-margin	diff	10.0+0.10	LLR: -0.82 (-2.25, 2.89) [0.00, 3.00] Games: 1754 W: 419 L: 467 D: 868 Ptnml(0-2): 17, 227, 430, 193, 10
World	Peregrine	fractional-lmr-history	diff	10.0+0.10	LLR: -0.61 (-2.25, 2.89) [0.00, 3.00] Games: 2106 W: 501 L: 534 D: 1071 Ptnml(0-2): 11, 277, 505, 254, 6
World	Peregrine	probcut-threshold	diff	10.0+0.10	LLR: -0.69 (-2.25, 2.89) [0.00, 3.00] Games: 2970 W: 735 L: 771 D: 1464 Ptnml(0-2): 22, 368, 733, 348, 14
World	Peregrine	lmr-madness	diff	10.0+0.10	LLR: -1.57 (-2.25, 2.89) [0.00, 3.00] Games: 7482 W: 1781 L: 1861 D: 3840 Ptnml(0-2): 49, 931, 1849, 875, 37
World	Peregrine	expt-07-finetuning	diff	10.0+0.10	LLR: -1.07 (-2.25, 2.89) [0.00, 3.00] Games: 9186 W: 2335 L: 2382 D: 4469 Ptnml(0-2): 68, 1159, 2194, 1096, 76
World	Peregrine	expt-07-finetuning	diff	N=25000	LLR: -1.86 (-2.25, 2.89) [0.00, 3.00] Games: 17376 W: 5838 L: 5941 D: 5597 Ptnml(0-2): 710, 1910, 3491, 1927, 650
World	Peregrine	expt-07-finetuning	diff	10.0+0.10	Tuning 192 Parameters 2500/2500 Iterations 40008/40000 Games Played
World	Peregrine	expt-07-finetuning	diff	10.0+0.10	LLR: -0.51 (-2.25, 2.89) [0.00, 3.00] Games: 9080 W: 2298 L: 2309 D: 4473 Ptnml(0-2): 77, 1123, 2144, 1126, 70
World	Peregrine	expt-07-finetuning	diff	N=25000	LLR: -2.30 (-2.25, 2.89) [0.00, 3.00] Games: 14962 W: 5083 L: 5231 D: 4648 Ptnml(0-2): 646, 1600, 3072, 1582, 581
World	Peregrine	mat-scale-pawns	diff	10.0+0.10	LLR: -0.57 (-2.25, 2.89) [0.00, 3.00] Games: 2278 W: 548 L: 579 D: 1151 Ptnml(0-2): 13, 305, 539, 264, 18
World	Peregrine	prefetch-eariler	diff	6.0+0.06	LLR: -0.27 (-2.25, 2.89) [0.00, 3.00] Games: 6080 W: 1529 L: 1532 D: 3019 Ptnml(0-2): 47, 740, 1469, 737, 47
World	Peregrine	spsa10	diff	10.0+0.10	Tuning 89 Parameters 4108/7500 Iterations 65732/120000 Games Played
World	Peregrine	spsa10-50k	diff	10.0+0.10	LLR: 0.26 (-2.25, 2.89) [0.00, 3.00] Games: 27782 W: 6862 L: 6781 D: 14139 Ptnml(0-2): 167, 3365, 6727, 3484, 148
World	Peregrine	expt-06-finetuning-raw	diff	10.0+0.10	Elo: -1.39 +- 3.82 (95%) [N=40000] Games: 9724 W: 2430 L: 2469 D: 4825 Ptnml(0-2): 67, 1227, 2324, 1166, 78
World	Peregrine	expt-06-finetuning-raw	diff	N=25000	LLR: -1.29 (-2.25, 2.89) [0.00, 3.00] Games: 5622 W: 1856 L: 1948 D: 1818 Ptnml(0-2): 251, 606, 1155, 582, 217

1 2 3 153 154 155 156 157 192 193 194