|
BGonline.org Forums
Using Noisy Evaluations to Measure Performance
Posted By: Timothy Chow In Response To: Using Noisy Evaluations to Measure Performance (Chris Yep)
Date: Thursday, 31 March 2016, at 11:32 p.m.
I've stated this before but I feel that it's worth stating again.
The main problem with error rate measurements is that there are too many of them. Creating a new system just exacerbates this main problem.
For the error rate to mean anything, it has to be averaged over a very large sample. And if the sample is large enough, then I strongly suspect that every reasonable measure converges to the same limit anyway, up to a constant scale factor.
|
BGonline.org Forums is maintained by Stick with WebBBS 5.12.