|
BGonline.org Forums
Bot Comparison Final Table UPDATED
Posted By: Michael Depreli In Response To: Bot Comparison Final Table (Michael Depreli)
Date: Saturday, 28 January 2012, at 7:55 p.m.
Here is an updated table for the original Bot Comparison which now includes XG2 and was done with much stronger rollout settings:
XG2 3-ply Checker XG Roller Cube minimum 1296 trials no maximum until error is less than 0.005.
The process for extracting the data from the rollouts can now be automated for XG, GnuBG and Bgblitz although I don't have the
technical knowledge how to do it so if Frank or anyone from the GnuBG team wants to add their data just email me.I won't be updating the Snowie data.
Many thanks to the rollateers:
Frank Berger
Xavier Dufaure de Citres
Neil Kazaross
Michael Petch
Miran Tuhtan
BOT COMPARISON UPDATED TABLE CH CUBE Version Level CH MD WD WP WT Total Cube Total 2 XGR++ 3.668 0.115 0.223 0.199 0.028 0.564 4.232 2 XGR+ 5.458 0.479 0.261 0.391 0.020 1.151 6.608 2 5-Ply 7.082 0.968 0.392 0.618 0.104 2.082 9.163 2 4-Ply 9.787 0.356 1.159 0.566 0.160 2.241 12.028 1 XGR+ 9.226 1.696 0.665 1.686 0.030 4.077 13.303 2 XGR 12.843 0.495 0.989 0.401 0.160 2.044 14.887 2 3-Ply 13.199 1.214 1.003 0.704 0.196 3.116 16.316 1 5-Ply 12.853 2.185 0.932 3.151 0.367 6.635 19.488 1 4-Ply 17.917 0.656 1.740 1.046 0.401 3.843 21.760 1 XGR 16.271 2.417 0.915 2.558 0.070 5.960 22.232 2 3-Ply Red 19.689 1.424 1.160 0.704 0.196 3.484 23.173 1 3-Ply 22.202 2.217 1.634 4.400 0.776 9.027 31.228 Here's the original table:
BOT COMPARISON FINAL TABLE 500 GAMES
BOT
PLY
Checker
Missed
Wrong
D/ND
Wrong
Wrong
T/P
Cube
TOTAL
Errors
Double
Double
Errors
Take
Pass
Errors
Errors
eXtreme Gammon
XGR+
13.397
1.088
0.658
1.746
0.970
0.241
1.211
2.957
16.354
eXtreme Gammon
XGR
22.269
1.661
0.783
2.444
2.173
0.264
2.437
4.881
27.150
eXtreme Gammon
5-Ply
17.169
1.507
0.789
2.296
2.859
0.450
3.309
5.605
22.774
GNUBG
4-Ply
21.599
2.663
0.644
3.307
4.061
0.127
4.188
7.495
29.094
eXtreme Gammon
4-Ply
22.967
0.426
1.647
2.073
0.818
0.555
1.373
3.446
26.413
GNUBG
3-Ply
29.313
0.903
10.276
11.179
0.775
5.880
6.655
17.834
47.147
eXtreme Gammon
3-Ply
27.814
1.831
1.528
3.359
3.996
0.520
4.516
7.875
35.689
GNUBG
2-Ply
33.247
2.763
1.670
4.433
4.261
0.476
4.737
9.170
42.417
Snowie 4
3-Ply
37.424
1.922
1.139
3.061
3.651
0.867
4.518
7.579
45.003
BG Blitz
3-Ply
41.286
1.692
17.263
18.955
4.168
2.159
6.327
25.282
66.568
Rollout Parameters Gnubg 2-Ply World Class 1296 trials or 2.33 J.S.D. Minimum 720 trials
>> Opening rolls and replies rollout data from Stick's Gnubg rollouts at www.bgonline.org
|
BGonline.org Forums is maintained by Stick with WebBBS 5.12.