OpenBench

OpenBench Testing Framework

Finished
Peregr	Peregrine	before-bf42e351	diff	10.0+0.10	Elo: 3.81 +- 5.63 (95%) [N=40000] Games: 3374 W: 548 L: 511 D: 2315 Ptnml(0-2): 18, 302, 1006, 347, 14
Peregr	Peregrine	beforeNetTune	diff	10.0+0.10	Elo: 3.37 +- 3.89 (95%) [N=40000] Games: 7420 W: 1247 L: 1175 D: 4998 Ptnml(0-2): 51, 658, 2220, 730, 51
World	Peregrine	main	diff	10.0+0.10	Elo: 5.02 +- 3.39 (95%) [N=40000] Games: 9344 W: 1587 L: 1452 D: 6305 Ptnml(0-2): 47, 811, 2834, 920, 60
Peregr	Peregrine	pcmTTCut2	diff	10.0+0.10	LLR: -0.79 (-2.25, 2.89) [0.00, 3.00] Games: 5530 W: 843 L: 875 D: 3812 Ptnml(0-2): 31, 522, 1687, 498, 27
Peregr	Peregrine	pcmTTCut	diff	10.0+0.10	LLR: -0.62 (-2.25, 2.89) [0.00, 3.00] Games: 10368 W: 1585 L: 1598 D: 7185 Ptnml(0-2): 56, 957, 3174, 938, 59
Peregr	Peregrine	pcmTTcutErgodice	diff	10.0+0.10	LLR: -0.90 (-2.25, 2.89) [0.00, 3.00] Games: 1356 W: 180 L: 227 D: 949 Ptnml(0-2): 12, 135, 425, 100, 6
World	Peregrine	eval-function	diff	10.0+0.10	LLR: -0.30 (-2.25, 2.89) [-3.00, 0.00] Games: 3934 W: 588 L: 613 D: 2733 Ptnml(0-2): 25, 376, 1191, 349, 26
World	Peregrine	ergo-stuff-2	diff	10.0+0.10	LLR: -0.95 (-2.25, 2.89) [0.00, 3.00] Games: 3922 W: 612 L: 657 D: 2653 Ptnml(0-2): 24, 389, 1174, 356, 18
World	Peregrine	expt-47-2000	diff	10.0+0.10	LLR: -0.59 (-2.25, 2.89) [0.00, 3.00] Games: 10600 W: 1981 L: 1993 D: 6626 Ptnml(0-2): 107, 1112, 2865, 1118, 98
World	Peregrine	expt-45-3000	diff	10.0+0.10	LLR: -0.71 (-2.25, 2.89) [0.00, 3.00] Games: 4110 W: 697 L: 730 D: 2683 Ptnml(0-2): 31, 422, 1184, 385, 33
World	Peregrine	expt-45-3000	diff	N=25000	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 10706 W: 3242 L: 3399 D: 4065 Ptnml(0-2): 451, 1224, 2088, 1211, 379
World	Peregrine	expt-47-2000	diff	N=25000	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 5506 W: 1683 L: 1863 D: 1960 Ptnml(0-2): 252, 678, 1044, 556, 223
World	Peregrine	net-spsa-6-40k	diff	10.0+0.10	LLR: 2.94 (-2.25, 2.89) [0.00, 3.00] Games: 18398 W: 2989 L: 2788 D: 12621 Ptnml(0-2): 77, 1664, 5556, 1785, 117
Peregr	Peregrine	spsa20-200k	diff	10.0+0.10	LLR: 2.94 (-2.25, 2.89) [0.00, 3.00] Games: 10616 W: 1747 L: 1563 D: 7306 Ptnml(0-2): 49, 900, 3246, 1044, 69
World	Peregrine	net-spsa-5	diff	10.0+0.10	Tuning 192 Parameters 16086/25000 Iterations 64346/100000 Games Played
Peregr	Peregrine	simpl9	diff	10.0+0.10	LLR: -2.27 (-2.25, 2.89) [-3.00, 0.00] Games: 35588 W: 5423 L: 5620 D: 24545 Ptnml(0-2): 200, 3288, 11004, 3113, 189
World	Peregrine	net-spsa-6	diff	10.0+0.10	Tuning 64 Parameters 10000/10000 Iterations 40002/40000 Games Played
Peregr	Peregrine	spsa20	diff	10.0+0.10	Tuning 133 Parameters 50001/50000 Iterations 200006/200000 Games Played
World	Peregrine	expt-44	diff	10.0+0.10	Elo: -8.03 +- 5.08 (95%) [N=40000] Games: 4936 W: 833 L: 947 D: 3156 Ptnml(0-2): 50, 547, 1377, 455, 39
World	Peregrine	expt-44	diff	N=25000	Elo: -6.07 +- 4.11 (95%) [N=40000] Games: 15100 W: 4473 L: 4737 D: 5890 Ptnml(0-2): 638, 1817, 2826, 1709, 560
World	Peregrine	expt-43	diff	10.0+0.10	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 4354 W: 736 L: 869 D: 2749 Ptnml(0-2): 53, 505, 1178, 404, 37
World	Peregrine	expt-43	diff	N=25000	LLR: -2.15 (-2.25, 2.89) [0.00, 3.00] Games: 4452 W: 1303 L: 1476 D: 1673 Ptnml(0-2): 193, 580, 840, 433, 180
Peregr	Peregrine	rfpSanity	diff	10.0+0.10	LLR: 2.17 (-2.25, 2.89) [-3.00, 0.00] Games: 16608 W: 2673 L: 2587 D: 11348 Ptnml(0-2): 105, 1466, 5060, 1584, 89
World	Peregrine	tt-capture-depth	diff	10.0+0.10	LLR: -0.71 (-2.25, 2.89) [0.00, 3.00] Games: 16660 W: 2577 L: 2582 D: 11501 Ptnml(0-2): 89, 1519, 5127, 1498, 97
Peregr	Peregrine	lmrStuff	diff	10.0+0.10	LLR: -1.31 (-2.25, 2.89) [0.00, 3.00] Games: 55392 W: 8411 L: 8370 D: 38611 Ptnml(0-2): 279, 5029, 17044, 5060, 284

1 2 3 380 381 382 383 384 451 452 453