OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	tm-spsa-5	diff	10.0+0.00	LLR: -1.26 (-2.25, 2.89) [0.00, 3.00] Games: 44800 W: 7294 L: 7271 D: 30235 Ptnml(0-2): 242, 4159, 13600, 4132, 267
World	Peregrine	mtg-scaling-fix	diff	15.0+0.00	LLR: -0.52 (-2.25, 2.89) [-3.00, 0.00] Games: 38144 W: 5549 L: 5643 D: 26952 Ptnml(0-2): 119, 2893, 13143, 2797, 120
World	Peregrine	mtg-scaling-fix-10pct	diff	20.0+0.00	Elo: 0.30 +- 4.64 (95%) [N=40000] Games: 3426 W: 475 L: 472 D: 2479 Ptnml(0-2): 5, 241, 1227, 226, 14
World	Peregrine	mtg-scaling-fix-10pct	diff	10.0+0.00	Elo: -19.73 +- 5.73 (95%) [N=40000] Games: 3208 W: 463 L: 645 D: 2100 Ptnml(0-2): 27, 368, 982, 214, 13
World	Peregrine	expt-50	diff	10.0+0.10	Elo: -2.87 +- 4.34 (95%) [N=40000] Games: 7028 W: 1280 L: 1338 D: 4410 Ptnml(0-2): 63, 781, 1881, 729, 60
World	Peregrine	expt-50	diff	N=25000	Elo: 1.82 +- 4.68 (95%) [N=40000] Games: 12016 W: 3691 L: 3628 D: 4697 Ptnml(0-2): 511, 1349, 2215, 1432, 501
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	Tuning 21 Parameters 32000/32000 Iterations 64000/64000 Games Played
World	Peregrine	expt-50	diff	10.0+0.10	Elo: -10.11 +- 6.27 (95%) [N=40000] Games: 3198 W: 529 L: 622 D: 2047 Ptnml(0-2): 29, 371, 886, 290, 23
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	LLR: 2.90 (-2.25, 2.89) [-3.00, 0.00] Games: 36292 W: 5959 L: 5875 D: 24458 Ptnml(0-2): 195, 3166, 11339, 3252, 194
World	Peregrine	mtg-scaling-fix	diff	10.0+0.00	LLR: -2.26 (-2.25, 2.89) [-3.00, 0.00] Games: 1882 W: 274 L: 404 D: 1204 Ptnml(0-2): 24, 216, 570, 128, 3
World	Peregrine	ctfpcm-2	diff	10.0+0.10	LLR: -0.93 (-2.25, 2.89) [0.00, 3.00] Games: 6236 W: 928 L: 966 D: 4342 Ptnml(0-2): 34, 583, 1911, 567, 23
World	Peregrine	lmr-test6	diff	10.0+0.10	LLR: -0.28 (-2.25, 2.89) [0.00, 3.00] Games: 7962 W: 1223 L: 1222 D: 5517 Ptnml(0-2): 48, 703, 2471, 718, 41
World	Peregrine	lmr-test5	diff	10.0+0.10	LLR: -0.78 (-2.25, 2.89) [0.00, 3.00] Games: 8340 W: 1258 L: 1283 D: 5799 Ptnml(0-2): 46, 729, 2625, 744, 26
World	Peregrine	lmr-test4	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 7966 W: 1156 L: 1189 D: 5621 Ptnml(0-2): 30, 752, 2461, 701, 39
World	Peregrine	lmr-exploration-2	diff	10.0+0.10	Tuning 200 Parameters 26224/40000 Iterations 52448/80000 Games Played
World	Peregrine	lmr-test3	diff	10.0+0.10	LLR: -2.32 (-2.25, 2.89) [0.00, 3.00] Games: 9008 W: 1301 L: 1410 D: 6297 Ptnml(0-2): 57, 861, 2759, 788, 39
World	Peregrine	lmr-test3	diff	10.0+0.10	LLR: 0.37 (-2.25, 2.89) [0.00, 3.00] Games: 6422 W: 987 L: 953 D: 4482 Ptnml(0-2): 36, 567, 1980, 583, 45
World	Peregrine	lmr-test2	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [0.00, 3.00] Games: 24860 W: 3908 L: 3700 D: 17252 Ptnml(0-2): 101, 2181, 7700, 2305, 143
World	Peregrine	spsa21	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 38884 W: 6119 L: 5881 D: 26884 Ptnml(0-2): 207, 3388, 12014, 3626, 207
World	Peregrine	main	diff	10.0+0.10	Tuning 140 Parameters 50003/50000 Iterations 100006/100000 Games Played
World	Peregrine	expt-49	diff	10.0+0.10	LLR: -0.71 (-2.25, 2.89) [-3.00, 0.00] Games: 4390 W: 779 L: 833 D: 2778 Ptnml(0-2): 39, 493, 1190, 429, 44
World	Peregrine	lmr-test1	diff	10.0+0.10	LLR: -0.96 (-2.25, 2.89) [0.00, 3.00] Games: 3110 W: 444 L: 490 D: 2176 Ptnml(0-2): 21, 300, 946, 280, 8
World	Peregrine	expt-49	diff	10.0+0.10	LLR: 0.02 (-2.25, 2.89) [-3.00, 0.00] Games: 6746 W: 1205 L: 1219 D: 4322 Ptnml(0-2): 48, 736, 1834, 692, 63
World	Peregrine	spsa-4th-bucket	diff	10.0+0.10	LLR: -0.91 (-2.25, 2.89) [0.00, 3.00] Games: 46440 W: 7137 L: 7092 D: 32211 Ptnml(0-2): 251, 4203, 14246, 4290, 230
World	Peregrine	main	diff	10.0+0.10	Tuning 128 Parameters 20002/20000 Iterations 40004/40000 Games Played

1 2 3 46 47 48 49 50 102 103 104