BGonline.org Forums

Nine 5k results (report) - that why people need to check SI

Posted By: Timothy Chow
Date: Tuesday, 18 January 2011, at 5:30 p.m.

In Response To: Nine 5k results (report) - that why people need to check SI (eXtreme Gammon)

Part of what's subtle about this subject is that the decision about how long to roll something out can affect the statistical significance.

If everyone always rolled out positions 5184 times then it's likely that the confidence intervals would fairly accurately represent what we intuitively think they should, except perhaps in positions where the cube is getting repeated turned. However, that's not what happens in practice. People roll a position out for a while, then look at what's going on, and stop or continue based on whether they like what they see. This natural and seemingly innocuous procedure affects the statistical significance more than one might think. Unfortunately there's no easy way to program the bot to take this into account properly, because it depends on the details of how the rollout choices are made, and most people are not even conscious of the subtle choices they're making, let alone disciplined enough to follow a strict protocol every time.

Messages In This Thread

• Opening 52 at 4 away 4 away
  Stick -- Saturday, 15 January 2011, at 9:00 p.m.
  • Opening 52 at 4 away 4 away
    neilkaz -- Saturday, 15 January 2011, at 9:37 p.m.
  • Stat sig
    Timothy Chow -- Sunday, 16 January 2011, at 2:35 p.m.
  • Opening 52 at 4 away 4 away - extended
    Stick -- Monday, 17 January 2011, at 9:55 a.m.
    • Nine 5k results (report)
      Nack Ballard -- Monday, 17 January 2011, at 3:20 p.m.
      • Nine 5k results (report) - that why people need to check SI
        eXtreme Gammon -- Monday, 17 January 2011, at 6:00 p.m.
        • Nine 5k results (report) - that why people need to check SI
          Stick -- Monday, 17 January 2011, at 6:15 p.m.
          • Nine 5k results (report) - that why people need to check SI
            eXtreme Gammon -- Monday, 17 January 2011, at 6:56 p.m.
            • Nine 5k results (report) - that why people need to check SI
              Nack Ballard -- Monday, 17 January 2011, at 10:59 p.m.
            • Nine 5k results (report) - that why people need to check SI
              Neil Robins -- Tuesday, 18 January 2011, at 9:34 p.m.
              • Nine 5k results (report) - that why people need to check SI
                eXtreme Gammon -- Wednesday, 19 January 2011, at 4:47 a.m.
                • Nine 5k results (report) - that why people need to check SI
                  Timothy Chow -- Wednesday, 19 January 2011, at 2:33 p.m.
              • Nine 5k results (report) - that why people need to check SI
                Daniel Murphy -- Wednesday, 19 January 2011, at 9:10 p.m.
        • You mean CI *NM*
          neilkaz -- Monday, 17 January 2011, at 6:41 p.m.
          • You mean CI - I did indeed *NM*
            eXtreme Gammon -- Monday, 17 January 2011, at 6:56 p.m.
        • Nine 5k results (report) - that why people need to check SI
          Timothy Chow -- Tuesday, 18 January 2011, at 5:30 p.m.
      • Nine 5k results (report)
        Daniel Murphy -- Monday, 17 January 2011, at 9:43 p.m.