| |
BGonline.org Forums
Are we missing the most important point by Michael?
Posted By: Maik Stiebler In Response To: Are we missing the most important point by Michael? (Frank Berger)
Date: Monday, 24 August 2009, at 6:50 a.m.
As Chuck noted, problems appear if a new bot disagrees in a position where all the old bots agree and which is thus not in the set. It is true that the new bot can be more right or more wrong than all the old bots.
IMHO this effect will be small,I agree.
unclear whther it is an advantage or notIt makes some sense to assume that the new bot will be more wrong more often than more right in the positions that are not in the old set, I think, simply because the new bot will be in the minority. Obviously if the new bot is much stronger than the old bots, that argument does not work.
any selection of position might have a bias for any bot.Yes, I don't see any way in which any selection of positions could be an unbiased indicator of skill for all bots. Actually it's not even easy to define what skill of a bot really is. Chuck's suggestion makes sure that the results from the new set of positions are relatively speaking the same as when every decision from the original set of games is rolled out.
| |
BGonline.org Forums is maintained by Stick with WebBBS 5.12.