| |
BGonline.org Forums
A better approch?
Posted By: Timothy Chow In Response To: A better approch? (eXtreme Gammon)
Date: Monday, 2 November 2009, at 6:40 p.m.
If you really want to report your result as "the probability that play X is the best" then I think you should really use a Bayesian approach, as I explained in a post I made here a couple of months ago.
If you think about it closely, calculating some tail region in a multidimensional Gaussian with the estimated parameters you listed does not answer the question, "What is the probability that this play is the best?" When you write down those means and standard deviations, what you're saying is, "This is my best estimate of the mean and standard deviation of the equity of this move." The tail probability is then telling you the probability of some rare event happening, given that your estimated mean and standard deviation are accurate. But this is the opposite of the question you really want to ask. You want to know, what is the probability that I would see the results I am actually observing, given that this lower-scoring play is in fact the best one?
The only way to answer the latter question is to fix some prior probabilities and update those probabilities as you accumulate evidence.
| |
BGonline.org Forums is maintained by Stick with WebBBS 5.12.