BGonline.org Forums

The Michael Depreli Bot Comparisons

Posted By: Frank Berger
Date: Tuesday, 15 February 2011, at 5:31 p.m.

In Response To: The Michael Depreli Bot Comparisons (Art Grater)

Hi Art,

given that the differences we are talking about are very small, a sample of 500 games means close to nothing. For comparing candidate neural nets for BGBlitz I run 8 million games and even this is not enough to answer all questions.

The benchmark works in comparing the deviations of the bots during analyzes, makes rollouts of the differing moves and add up the error.

IMHO an excellent approach to get a quick evaluation of an bots strength.

ciao Frank

Messages In This Thread

• The Michael Depreli Bot Comparisons
  Tom Keith -- Monday, 14 February 2011, at 7:03 p.m.
  • The Michael Depreli Bot Comparisons
    Casper van der Tak -- Monday, 14 February 2011, at 7:10 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:56 p.m.
  • The Michael Depreli Bot Comparisons
    Daniel Murphy -- Monday, 14 February 2011, at 7:46 p.m.
    • The Michael Depreli Bot Comparisons
      Daniel Murphy -- Monday, 14 February 2011, at 7:51 p.m.
    • The Michael Depreli Bot Comparisons
      Frank Berger -- Monday, 14 February 2011, at 11:03 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:55 p.m.
  • The Michael Depreli Bot Comparisons
    Timothy Chow -- Tuesday, 15 February 2011, at 12:29 a.m.
    • The Michael Depreli Bot Comparisons
      Stick -- Tuesday, 15 February 2011, at 1:53 a.m.
      • The Michael Depreli Bot Comparisons
        Frank Berger -- Tuesday, 15 February 2011, at 7:03 a.m.
        • The Michael Depreli Bot Comparisons
          Timothy Chow -- Tuesday, 15 February 2011, at 2:57 p.m.
          • The Michael Depreli Bot Comparisons
            Stick -- Tuesday, 15 February 2011, at 3:35 p.m.
  • The Michael Depreli Bot Comparisons
    Nack Ballard -- Tuesday, 15 February 2011, at 4:03 a.m.
    • The Michael Depreli Bot Comparisons - Anyone want to do the speed study?
      eXtreme Gammon -- Tuesday, 15 February 2011, at 5:03 a.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:53 p.m.
  • The Michael Depreli Bot Comparisons
    Art Grater -- Tuesday, 15 February 2011, at 8:36 a.m.
    • The Michael Depreli Bot Comparisons
      Frank Berger -- Tuesday, 15 February 2011, at 5:31 p.m.
  • The Michael Depreli Bot Comparisons
    Christian Munk-Christensen -- Tuesday, 15 February 2011, at 1:12 p.m.
    • The Michael Depreli Bot Comparisons
      Tom Keith -- Tuesday, 15 February 2011, at 3:44 p.m.
      • The Michael Depreli Bot Comparisons
        Frank Berger -- Tuesday, 15 February 2011, at 5:37 p.m.
    • The Michael Depreli Bot Comparisons
      neilkaz -- Tuesday, 15 February 2011, at 4:40 p.m.