OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	expt-50	diff	N=25000	Elo: 1.82 +- 4.68 (95%) [N=40000] Games: 12016 W: 3691 L: 3628 D: 4697 Ptnml(0-2): 511, 1349, 2215, 1432, 501
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	Tuning 21 Parameters 32000/32000 Iterations 64000/64000 Games Played
World	Peregrine	expt-50	diff	10.0+0.10	Elo: -10.11 +- 6.27 (95%) [N=40000] Games: 3198 W: 529 L: 622 D: 2047 Ptnml(0-2): 29, 371, 886, 290, 23
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	LLR: 2.90 (-2.25, 2.89) [-3.00, 0.00] Games: 36292 W: 5959 L: 5875 D: 24458 Ptnml(0-2): 195, 3166, 11339, 3252, 194
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	LLR: -2.26 (-2.25, 2.89) [-3.00, 0.00] Games: 1882 W: 274 L: 404 D: 1204 Ptnml(0-2): 24, 216, 570, 128, 3
World	Peregrine	ctfpcm-2	diff	10.0+0.10	LLR: -0.93 (-2.25, 2.89) [0.00, 3.00] Games: 6236 W: 928 L: 966 D: 4342 Ptnml(0-2): 34, 583, 1911, 567, 23
World	Peregrine	lmr-test6	diff	10.0+0.10	LLR: -0.28 (-2.25, 2.89) [0.00, 3.00] Games: 7962 W: 1223 L: 1222 D: 5517 Ptnml(0-2): 48, 703, 2471, 718, 41
World	Peregrine	lmr-test5	diff	10.0+0.10	LLR: -0.78 (-2.25, 2.89) [0.00, 3.00] Games: 8340 W: 1258 L: 1283 D: 5799 Ptnml(0-2): 46, 729, 2625, 744, 26
World	Peregrine	lmr-test4	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 7966 W: 1156 L: 1189 D: 5621 Ptnml(0-2): 30, 752, 2461, 701, 39
World	Peregrine	lmr-exploration-2	diff	10.0+0.10	Tuning 200 Parameters 26224/40000 Iterations 52448/80000 Games Played
World	Peregrine	lmr-test3	diff	10.0+0.10	LLR: -2.32 (-2.25, 2.89) [0.00, 3.00] Games: 9008 W: 1301 L: 1410 D: 6297 Ptnml(0-2): 57, 861, 2759, 788, 39
World	Peregrine	lmr-test3	diff	10.0+0.10	LLR: 0.37 (-2.25, 2.89) [0.00, 3.00] Games: 6422 W: 987 L: 953 D: 4482 Ptnml(0-2): 36, 567, 1980, 583, 45
World	Peregrine	lmr-test2	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 24860 W: 3908 L: 3700 D: 17252 Ptnml(0-2): 101, 2181, 7700, 2305, 143
World	Peregrine	spsa21	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 38884 W: 6119 L: 5881 D: 26884 Ptnml(0-2): 207, 3388, 12014, 3626, 207
World	Peregrine	main	diff	10.0+0.10	Tuning 140 Parameters 50003/50000 Iterations 100006/100000 Games Played
World	Peregrine	expt-49	diff	10.0+0.10	LLR: -0.71 (-2.25, 2.89) [-3.00, 0.00] Games: 4390 W: 779 L: 833 D: 2778 Ptnml(0-2): 39, 493, 1190, 429, 44
World	Peregrine	lmr-test1	diff	10.0+0.10	LLR: -0.96 (-2.25, 2.89) [0.00, 3.00] Games: 3110 W: 444 L: 490 D: 2176 Ptnml(0-2): 21, 300, 946, 280, 8
World	Peregrine	expt-49	diff	10.0+0.10	LLR: 0.02 (-2.25, 2.89) [-3.00, 0.00] Games: 6746 W: 1205 L: 1219 D: 4322 Ptnml(0-2): 48, 736, 1834, 692, 63
World	Peregrine	spsa-4th-bucket	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 46440 W: 7137 L: 7092 D: 32211 Ptnml(0-2): 251, 4203, 14246, 4290, 230
World	Peregrine	main	diff	10.0+0.10	Tuning 128 Parameters 20002/20000 Iterations 40004/40000 Games Played
World	Peregrine	tweak-50mr-damping	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 8174 W: 1241 L: 1274 D: 5659 Ptnml(0-2): 33, 775, 2508, 734, 37
World	Peregrine	eval-function	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [-3.00, 0.00] Games: 22474 W: 3525 L: 3412 D: 15537 Ptnml(0-2): 104, 2022, 6882, 2115, 114
World	Peregrine	expt-48	diff	10.0+0.10	LLR: -2.28 (-2.25, 2.89) [-3.00, 0.00] Games: 6468 W: 1022 L: 1168 D: 4278 Ptnml(0-2): 62, 669, 1887, 585, 31
World	Peregrine	eval-function	diff	10.0+0.10	Tuning 6 Parameters 5002/5000 Iterations 20008/20000 Games Played
World	Peregrine	main	diff	10.0+0.10	Elo: 3.25 +- 3.48 (95%) [N=40000] Games: 10896 W: 2767 L: 2665 D: 5464 Ptnml(0-2): 67, 1242, 2721, 1358, 60

1 2 3 214 215 216 217 218 270 271 272