BGonline.org Forums

The Michael Depreli Bot Comparisons

Posted By: Tom Keith
Date: Tuesday, 15 February 2011, at 3:53 p.m.

In Response To: The Michael Depreli Bot Comparisons (Nack Ballard)

Thanks for the comments, Nack.

About the strength-vs-speed table, I admit I'm a sucker for pretty graphics. Xavier did a nice job of presenting this information alongside the strength numbers. And it is helpful to know the relative speed of the bots so you can compare them at similar settings.

But perhaps the bigger question is: Can a single set of numbers properly convey the speed information? The relative speed of Snowie is going to depend a lot on the number of cores in the processor you use for testing because Snowie is not optimized to use multiple cores. Is this unfair to Snowie? In some ways yes, in some ways no. It would be nice to have a more comprehensive study of relative bot speed, as Xavier suggests.

Also, offhand it seems to me that the bot chosen to do the arbitrating rollouts has an "unfair" advantage (Snowie in 2005, but more importantly GnuBG in 2010). I daren't venture a guess whether the effect is trivial or significant. (Perhaps the only fair way to do the study is to roll out all positions with all bots, though it would be highly impractical.)

One way to look into this some more would be to take a random sample of the positions that Snowie got wrong and roll them out in Snowie to see if any of the results are overturned (or if the size of the error changes significantly).

Messages In This Thread

• The Michael Depreli Bot Comparisons
  Tom Keith -- Monday, 14 February 2011, at 7:03 p.m.
  • The Michael Depreli Bot Comparisons
    Casper van der Tak -- Monday, 14 February 2011, at 7:10 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:56 p.m.
  • The Michael Depreli Bot Comparisons
    Daniel Murphy -- Monday, 14 February 2011, at 7:46 p.m.
    • The Michael Depreli Bot Comparisons
      Daniel Murphy -- Monday, 14 February 2011, at 7:51 p.m.
    • The Michael Depreli Bot Comparisons
      Frank Berger -- Monday, 14 February 2011, at 11:03 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:55 p.m.
  • The Michael Depreli Bot Comparisons
    Timothy Chow -- Tuesday, 15 February 2011, at 12:29 a.m.
    • The Michael Depreli Bot Comparisons
      Stick -- Tuesday, 15 February 2011, at 1:53 a.m.
      • The Michael Depreli Bot Comparisons
        Frank Berger -- Tuesday, 15 February 2011, at 7:03 a.m.
        • The Michael Depreli Bot Comparisons
          Timothy Chow -- Tuesday, 15 February 2011, at 2:57 p.m.
          • The Michael Depreli Bot Comparisons
            Stick -- Tuesday, 15 February 2011, at 3:35 p.m.
  • The Michael Depreli Bot Comparisons
    Nack Ballard -- Tuesday, 15 February 2011, at 4:03 a.m.
    • The Michael Depreli Bot Comparisons - Anyone want to do the speed study?
      eXtreme Gammon -- Tuesday, 15 February 2011, at 5:03 a.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:53 p.m.
  • The Michael Depreli Bot Comparisons
    Art Grater -- Tuesday, 15 February 2011, at 8:36 a.m.
    • The Michael Depreli Bot Comparisons
      Frank Berger -- Tuesday, 15 February 2011, at 5:31 p.m.
  • The Michael Depreli Bot Comparisons
    Christian Munk-Christensen -- Tuesday, 15 February 2011, at 1:12 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:44 p.m.
      • The Michael Depreli Bot Comparisons
        Frank Berger -- Tuesday, 15 February 2011, at 5:37 p.m.
    • The Michael Depreli Bot Comparisons
      neilkaz -- Tuesday, 15 February 2011, at 4:40 p.m.