| |
BGonline.org Forums
Bot Comparison redux. Rollateers needed.
Posted By: neilkaz In Response To: Bot Comparison redux. Rollateers needed. (Michael Depreli)
Date: Sunday, 14 August 2011, at 4:17 p.m.
I understand BGB's strength has been improved a couple of times since the last comparison. I've also heard of some slight improvements to GNU. I presume that the best versions of those two bots will be used and that may result in some different positions to RO than last time as well as some positions that were RO'd last time not needing to be RO's this time since all plies/bots agree.
Is the same set of 500 games being used or a new set?
As for setting the max to 46656 games, I think CI will almost always converge to less than .005 sooner than that even in complicated backgames, but it is a good fail safe stopping point.
Often one candidate play will reach .005 CI considerably sooner than another candidate play. May I presume that RO's for that candidate stop while the bot continues the RO for the other candidates until theu reach .005?
Many relatively simple positions won't need to go beyond 1296 games.
What about race DB? Different rollateers may have different settings. I assume just use it if you have it since it enhances slightly.
During my RO's for the last test, I noted a few times that immediate GNU 2 ply cube errors could mess up the results. (I'd tell Michael if I noted this) For example, the bots chose different plays, and all plays should go D/P but GNU was taking for once choice, thinking it was a .98 take when the RO result said 1.04 pass. As a result, that play may have been scored as .04 worse than the others when in reality all the plays were the same emg. Hopefully using a stronger bot and a stronger cube setting (XGR) will minimize the chances of this happening. Anyhow, it would really be overkill to RO everything as double/no double, I think.
Yeah, sure I can help do RO's .. neilkaz ..
| |
BGonline.org Forums is maintained by Stick with WebBBS 5.12.