OpenBench

OpenBench Testing Framework

Finished
World	Peregrine	expt-01-halved-target-run-01	diff	N=25000	Elo: 0.83 +- 3.00 (95%) [N=40000] Games: 30024 W: 10796 L: 10724 D: 8504 Ptnml(0-2): 1412, 3046, 6043, 3080, 1431
World	Peregrine	expt-01-halved-target-run-01	diff	10.0+0.10	Elo: -2.43 +- 3.11 (95%) [N=40000] Games: 17144 W: 4658 L: 4778 D: 7708 Ptnml(0-2): 254, 2126, 3906, 2058, 228
Peregr	Peregrine	cutNodeInCapture	diff	10.0+0.10	LLR: -2.33 (-2.25, 2.89) [0.00, 3.00] Games: 84116 W: 20684 L: 20633 D: 42799 Ptnml(0-2): 569, 10194, 20472, 10263, 560
World	Peregrine	lmr-complexity	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 27726 W: 6978 L: 7057 D: 13691 Ptnml(0-2): 221, 3428, 6646, 3345, 223
World	Peregrine	ordering-weights	diff	10.0+0.10	LLR: -0.80 (-2.25, 2.89) [0.00, 3.00] Games: 1484 W: 345 L: 393 D: 746 Ptnml(0-2): 20, 184, 372, 156, 10
Peregr	Peregrine	qsStagesThing	diff	10.0+0.10	LLR: -0.84 (-2.25, 2.89) [-3.00, 1.00] Games: 726 W: 152 L: 194 D: 380 Ptnml(0-2): 11, 98, 180, 70, 4
Peregr	Peregrine	tm-spsa2-37k	diff	10.0+0.10	LLR: -0.80 (-2.25, 2.89) [0.00, 3.00] Games: 8836 W: 2160 L: 2189 D: 4487 Ptnml(0-2): 58, 1034, 2270, 991, 65
World	Peregrine	rootdepth-piececount	diff	10.0+0.10	LLR: -0.20 (-2.25, 2.89) [0.00, 3.00] Games: 896 W: 225 L: 235 D: 436 Ptnml(0-2): 5, 99, 251, 87, 6
Peregr	Peregrine	corrPlexity1	diff	10.0+0.10	LLR: -1.08 (-2.25, 2.89) [0.00, 3.00] Games: 8364 W: 2108 L: 2157 D: 4099 Ptnml(0-2): 68, 1028, 2032, 993, 61
World	Peregrine	cflags	diff	10.0+0.10	LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 12356 W: 3139 L: 3079 D: 6138 Ptnml(0-2): 77, 1376, 3236, 1388, 101
Peregr	Peregrine	main *	diff	10.0+0.10	Elo: 59.54 +- 5.15 (95%) [N=40000] Games: 8178 W: 3372 L: 1984 D: 2822 Ptnml(0-2): 110, 566, 1676, 1300, 437
World	Peregrine	test78-janfeb2022-16tb7p	diff	10.0+0.10	LLR: -0.29 (-2.25, 2.89) [0.00, 3.00] Games: 6342 W: 1722 L: 1726 D: 2894 Ptnml(0-2): 81, 796, 1431, 772, 91
World	Peregrine	small-everything	diff	10.0+0.10	Elo: -76.17 +- 12.13 (95%) [N=40000] Games: 862 W: 121 L: 307 D: 434 Ptnml(0-2): 16, 190, 189, 36, 0
World	Peregrine	ciekce	diff	10.0+0.10	Elo: -83.61 +- 26.25 (95%) [N=40000] Games: 288 W: 52 L: 120 D: 116 Ptnml(0-2): 14, 58, 56, 14, 2
World	Peregrine	cleanups-8	diff	10.0+0.10	Elo: -4.10 +- 2.56 (95%) [N=40000] Games: 16108 W: 2102 L: 2292 D: 11714 Ptnml(0-2): 117, 1498, 4981, 1374, 84
Peregr	Peregrine	vizStuff2	diff	10.0+0.10	LLR: -1.25 (-2.25, 2.89) [0.00, 3.00] Games: 82816 W: 20337 L: 20221 D: 42258 Ptnml(0-2): 561, 10033, 20092, 10173, 549
Peregr	Peregrine	rmProbCnt	diff	10.0+0.10	LLR: -0.63 (-2.25, 2.89) [-3.00, 1.00] Games: 33706 W: 8152 L: 8235 D: 17319 Ptnml(0-2): 229, 4140, 8211, 4031, 242
Peregr	Peregrine	checkExt	diff	10.0+0.10	LLR: -1.00 (-2.25, 2.89) [0.00, 3.00] Games: 15660 W: 3814 L: 3840 D: 8006 Ptnml(0-2): 97, 1943, 3782, 1905, 103
Peregr	Peregrine	netWithcleaups-7	diff	10.0+0.10	Elo: 36.44 +- 3.49 (95%) [N=40000] Games: 13312 W: 4332 L: 2941 D: 6039 Ptnml(0-2): 86, 1155, 3006, 2100, 309
Peregr	Peregrine	tm_spsa2-25k	diff	10.0+0.10	LLR: -0.50 (-2.25, 2.89) [0.00, 3.00] Games: 8214 W: 2051 L: 2063 D: 4100 Ptnml(0-2): 62, 944, 2094, 958, 49
Peregr	Peregrine	hypotheticalReduction	diff	10.0+0.10	LLR: -0.83 (-2.25, 2.89) [0.00, 3.00] Games: 1536 W: 359 L: 406 D: 771 Ptnml(0-2): 11, 196, 398, 155, 8
Peregr	Peregrine	allMaterial	diff	10.0+0.10	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 24618 W: 5950 L: 6037 D: 12631 Ptnml(0-2): 174, 3031, 5968, 2980, 156
World	Peregrine	big-net-again	diff	10.0+0.10	Elo: 31.33 +- 6.47 (95%) [N=15000] Games: 3580 W: 772 L: 450 D: 2358 Ptnml(0-2): 29, 271, 915, 499, 76
Peregr	Peregrine	optimism1	diff	10.0+0.10	LLR: -1.75 (-2.25, 2.89) [0.00, 3.00] Games: 4016 W: 960 L: 1065 D: 1991 Ptnml(0-2): 53, 512, 958, 457, 28
World	Peregrine	expr44	diff	10.0+0.10	LLR: -0.53 (-2.25, 2.89) [0.00, 3.00] Games: 4840 W: 1273 L: 1297 D: 2270 Ptnml(0-2): 56, 612, 1117, 570, 65

1 2 3 414 415 416 417 418 451 452 453