OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	remove-root-key	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [-5.00, 0.00] Games: 17800 W: 4533 L: 4493 D: 8774 Ptnml(0-2): 127, 2015, 4596, 2015, 147
World	Peregrine	non-func-cleanups	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 7872 W: 2057 L: 1982 D: 3833 Ptnml(0-2): 44, 829, 2119, 896, 48
World	Peregrine	remove-squarebb	diff	10.0+0.10	LLR: 2.89 (-2.25, 2.89) [-5.00, 0.00] Games: 12058 W: 3097 L: 3038 D: 5923 Ptnml(0-2): 75, 1284, 3245, 1357, 68
World	Peregrine	simplify-countermove	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 11388 W: 2932 L: 2864 D: 5592 Ptnml(0-2): 94, 1407, 2630, 1463, 100
World	Peregrine	lmr-simplification-3	diff	10.0+0.10	LLR: -1.50 (-2.25, 2.89) [-3.00, 1.00] Games: 52950 W: 13347 L: 13505 D: 26098 Ptnml(0-2): 474, 6502, 12630, 6446, 423
World	Peregrine	tm-spsa2	diff	10.0+0.10	Tuning 24 Parameters 2850/5000 Iterations 45600/80000 Games Played
World	Peregrine	history-update	diff	10.0+0.10	LLR: -0.75 (-2.25, 2.89) [0.00, 3.00] Games: 4490 W: 1106 L: 1143 D: 2241 Ptnml(0-2): 42, 551, 1082, 542, 28
World	Peregrine	expt-04-batch-size-25000-run-01	diff	10.0+0.10	LLR: -1.46 (-2.25, 2.89) [0.00, 3.00] Games: 5928 W: 1608 L: 1694 D: 2626 Ptnml(0-2): 75, 801, 1299, 713, 76
World	Peregrine	qs-pruning	diff	10.0+0.10	LLR: -0.31 (-2.25, 2.89) [0.00, 3.00] Games: 49664 W: 12618 L: 12519 D: 24527 Ptnml(0-2): 399, 6017, 11891, 6136, 389
World	Peregrine	expt-01-halved-target-run-02	diff	10.0+0.10	LLR: -1.71 (-2.25, 2.89) [0.00, 3.00] Games: 6586 W: 1736 L: 1834 D: 3016 Ptnml(0-2): 75, 849, 1535, 767, 67
World	Peregrine	expt-01-halved-target-run-01	diff	N=25000	Elo: 0.83 +- 3.00 (95%) [N=40000] Games: 30024 W: 10796 L: 10724 D: 8504 Ptnml(0-2): 1412, 3046, 6043, 3080, 1431
World	Peregrine	expt-01-halved-target-run-01	diff	10.0+0.10	Elo: -2.43 +- 3.11 (95%) [N=40000] Games: 17144 W: 4658 L: 4778 D: 7708 Ptnml(0-2): 254, 2126, 3906, 2058, 228
World	Peregrine	lmr-complexity	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 27726 W: 6978 L: 7057 D: 13691 Ptnml(0-2): 221, 3428, 6646, 3345, 223
World	Peregrine	ordering-weights	diff	10.0+0.10	LLR: -0.80 (-2.25, 2.89) [0.00, 3.00] Games: 1484 W: 345 L: 393 D: 746 Ptnml(0-2): 20, 184, 372, 156, 10
World	Peregrine	rootdepth-piececount	diff	10.0+0.10	LLR: -0.20 (-2.25, 2.89) [0.00, 3.00] Games: 896 W: 225 L: 235 D: 436 Ptnml(0-2): 5, 99, 251, 87, 6
World	Peregrine	cflags	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 12356 W: 3139 L: 3079 D: 6138 Ptnml(0-2): 77, 1376, 3236, 1388, 101
World	Peregrine	test78-janfeb2022-16tb7p	diff	10.0+0.10	LLR: -0.29 (-2.25, 2.89) [0.00, 3.00] Games: 6342 W: 1722 L: 1726 D: 2894 Ptnml(0-2): 81, 796, 1431, 772, 91
World	Peregrine	small-everything	diff	10.0+0.10	Elo: -76.17 +- 12.13 (95%) [N=40000] Games: 862 W: 121 L: 307 D: 434 Ptnml(0-2): 16, 190, 189, 36, 0
World	Peregrine	ciekce	diff	10.0+0.10	Elo: -83.61 +- 26.25 (95%) [N=40000] Games: 288 W: 52 L: 120 D: 116 Ptnml(0-2): 14, 58, 56, 14, 2
World	Peregrine	cleanups-8	diff	10.0+0.10	Elo: -4.10 +- 2.56 (95%) [N=40000] Games: 16108 W: 2102 L: 2292 D: 11714 Ptnml(0-2): 117, 1498, 4981, 1374, 84
World	Peregrine	big-net-again	diff	10.0+0.10	Elo: 31.33 +- 6.47 (95%) [N=15000] Games: 3580 W: 772 L: 450 D: 2358 Ptnml(0-2): 29, 271, 915, 499, 76
World	Peregrine	expr44	diff	10.0+0.10	LLR: -0.53 (-2.25, 2.89) [0.00, 3.00] Games: 4840 W: 1273 L: 1297 D: 2270 Ptnml(0-2): 56, 612, 1117, 570, 65
World	Peregrine	expr44	diff	N=25000	LLR: -1.40 (-2.25, 2.89) [0.00, 3.00] Games: 9292 W: 3298 L: 3391 D: 2603 Ptnml(0-2): 457, 934, 1927, 901, 427
World	Peregrine	tm-spsa-11k	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 32922 W: 8359 L: 8105 D: 16458 Ptnml(0-2): 197, 3719, 8399, 3925, 221
World	Peregrine	tm-spsa	diff	10.0+0.10	Tuning 21 Parameters 1188/10000 Iterations 19008/160000 Games Played

1 2 3 113 114 115 116 117 145 146 147