BGonline.org Forums

A better approch? [LONG]

Posted By: MaX
Date: Tuesday, 10 November 2009, at 1:33 p.m.

In Response To: A better approch? [LONG] (Maik Stiebler)

Hi Maik, I do get your results now, we're in sync :)

NP2, Pmc, Pci_LB, Pci_UB

1, 96.120%, 96.145%, 96.145%

2, 93.098%, 92.439%, 96.145%

3, 90.737%, 88.875%, 96.145%

4, 88.516%, 85.449%, 96.145%

5, 86.924%, 82.155%, 96.145%

6, 85.123%, 78.988%, 96.145%

I've also notices that in my previous posts I've been talking about "true equities" when in fact I was talking about probability of win (DMP case). No big deal, they translates.

So we're OK with something like the minCI_LB to stop the rollout, show the minCI_UB (useful for play vs play comparisons) and then also show the Pmc for play1 being best of all.

Now for the philosophical question: I roll out play1 vs play2 (only 2 plays) and to get statsig 99.8% CI let's say (which should be very close to 98% Pmc) I need 1000 trials.

Then I do the same for play1 vs play3: 1000 trials for same statsig.

I fear a casual user will be very surprised to find out that if he rollouts plays 1, 2 and 3, in order to get the same Pmc (99.8%) he will need more than 1000 trials. But hey, at a given point you do have to explain something ... :)

MaX.

Messages In This Thread

• Confidence Interval Overlap vs Joint Standard Deviation (long)
  neilkaz -- Saturday, 31 October 2009, at 5:13 p.m.
  • Confidence Interval Overlap vs Joint Standard Deviation (long)
    Timothy Chow -- Saturday, 31 October 2009, at 5:30 p.m.
  • Confidence Interval Overlap vs Joint Standard Deviation (long)
    Tom Keith -- Saturday, 31 October 2009, at 5:51 p.m.
    • Confidence Interval Overlap vs Joint Standard Deviation (long)
      Rich Munitz -- Sunday, 1 November 2009, at 3:19 a.m.
  • Confidence Interval Overlap vs Joint Standard Deviation (long)
    Bob Koca -- Saturday, 31 October 2009, at 7:30 p.m.
    • Confidence Interval Overlap vs Joint Standard Deviation (long)
      neilkaz -- Saturday, 31 October 2009, at 9:20 p.m.
      • Confidence Interval Overlap vs Joint Standard Deviation (long)
        Bob Koca -- Saturday, 31 October 2009, at 9:31 p.m.
      • Confidence Interval Overlap vs Joint Standard Deviation (long)
        Timothy Chow -- Sunday, 1 November 2009, at 12:21 a.m.
  • A better approch?
    eXtreme Gammon -- Sunday, 1 November 2009, at 4:02 a.m.
    • A better approch?
      neilkaz -- Sunday, 1 November 2009, at 4:32 a.m.
    • A better approch?
      MaX -- Sunday, 1 November 2009, at 1:19 p.m.
    • A better approch?
      MaX -- Sunday, 1 November 2009, at 1:22 p.m.
    • A better approch?
      Timothy Chow -- Sunday, 1 November 2009, at 5:37 p.m.
      • A better approch?
        eXtreme Gammon -- Sunday, 1 November 2009, at 6:12 p.m.
        • A better approch?
          Bob Koca -- Sunday, 1 November 2009, at 7:36 p.m.
          • A better approch?
            Tom Keith -- Sunday, 1 November 2009, at 8:38 p.m.
            • A better approch?
              Chuck Bower -- Monday, 2 November 2009, at 1:20 a.m.
              • A better approch?
                Jason Lee -- Monday, 2 November 2009, at 2:24 a.m.
                • A better approch?
                  Chuck Bower -- Monday, 2 November 2009, at 3:06 p.m.
              • A better approch?
                Timothy Chow -- Monday, 2 November 2009, at 6:56 p.m.
        • A better approch?
          Maik Stiebler -- Sunday, 1 November 2009, at 10:05 p.m.
        • A better approch?
          MaX -- Monday, 2 November 2009, at 10:15 a.m.
          • A better approch?
            Timothy Chow -- Monday, 2 November 2009, at 6:47 p.m.
            • A better approch?
              MaX -- Tuesday, 3 November 2009, at 8:18 a.m.
          • A better approch?
            eXtreme Gammon -- Monday, 2 November 2009, at 7:26 p.m.
            • A better approch?
              MaX -- Thursday, 12 November 2009, at 12:56 p.m.
        • A better approch?
          Timothy Chow -- Monday, 2 November 2009, at 6:40 p.m.
          • A better approch?
            Tom Keith -- Monday, 2 November 2009, at 7:28 p.m.
            • A better approch?
              Timothy Chow -- Monday, 2 November 2009, at 10:10 p.m.
              • A better approch?
                Tom Keith -- Tuesday, 3 November 2009, at 12:14 a.m.
                • A better approch?
                  Timothy Chow -- Tuesday, 3 November 2009, at 1:29 a.m.
                  • A better approch?
                    Maik Stiebler -- Tuesday, 3 November 2009, at 7:18 a.m.
                    • A better approch?
                      Timothy Chow -- Tuesday, 3 November 2009, at 4:17 p.m.
                      • A better approch?
                        Tom Keith -- Tuesday, 3 November 2009, at 5:23 p.m.
                        • A better approch?
                          Timothy Chow -- Tuesday, 3 November 2009, at 5:37 p.m.
                          • Aren't you two just particpating in the 250 year old fracas?
                            Chuck Bower -- Tuesday, 3 November 2009, at 6:19 p.m.
                            • Aren't you two just particpating in the 250 year old fracas?
                              Timothy Chow -- Tuesday, 3 November 2009, at 7:55 p.m.
                              • Aren't you two just particpating in the 250 year old fracas?
                                Bob Koca -- Tuesday, 3 November 2009, at 8:29 p.m.
                            • Aren't you two just particpating in the 250 year old fracas?
                              Tom Keith -- Wednesday, 4 November 2009, at 12:11 p.m.
                      • A better approch?
                        Maik Stiebler -- Wednesday, 4 November 2009, at 8:40 p.m.
                        • A better approch?
                          Timothy Chow -- Wednesday, 4 November 2009, at 10:09 p.m.
                          • A better approch?
                            Maik Stiebler -- Wednesday, 4 November 2009, at 10:51 p.m.
                            • A better approch?
                              Maik Stiebler -- Wednesday, 4 November 2009, at 11:57 p.m.
                            • A better approch?
                              Timothy Chow -- Thursday, 5 November 2009, at 6:52 a.m.
                              • A better approch?
                                Maik Stiebler -- Thursday, 5 November 2009, at 7:25 a.m.
                                • A better approch?
                                  Timothy Chow -- Thursday, 5 November 2009, at 3:37 p.m.
                                  • A better approch?
                                    Maik Stiebler -- Thursday, 5 November 2009, at 9:19 p.m.
                                    • A better approch?
                                      Maik Stiebler -- Thursday, 5 November 2009, at 9:42 p.m.
          • A better approch? [LONG]
            MaX -- Thursday, 5 November 2009, at 3:04 p.m.
            • A better approch? [LONG]
              Timothy Chow -- Thursday, 5 November 2009, at 3:47 p.m.
            • A better approch? [LONG]
              Maik Stiebler -- Thursday, 5 November 2009, at 10:01 p.m.
              • A better approch? [LONG]
                MaX -- Friday, 6 November 2009, at 3:31 p.m.
                • A better approch? [LONG]
                  Maik Stiebler -- Saturday, 7 November 2009, at 5:52 p.m.
                  • A better approch? [LONG]
                    MaX -- Monday, 9 November 2009, at 12:39 p.m.
                    • A better approch? [LONG]
                      Maik Stiebler -- Monday, 9 November 2009, at 10:59 p.m.
                      • A better approch? [LONG]
                        MaX -- Tuesday, 10 November 2009, at 1:33 p.m.
        • A better approch?
          Tom Keith -- Thursday, 5 November 2009, at 10:23 p.m.
          • A better approch?
            MaX -- Friday, 6 November 2009, at 12:35 p.m.
    • A better approch?
      Bob Koca -- Sunday, 1 November 2009, at 7:45 p.m.
      • A better approch?
        eXtreme Gammon -- Sunday, 1 November 2009, at 10:03 p.m.
        • A better approch?
          Bob Koca -- Sunday, 1 November 2009, at 10:30 p.m.
    • A better approch?
      Mislav Radica -- Monday, 2 November 2009, at 12:59 a.m.
      • A better approch?
        eXtreme Gammon -- Monday, 2 November 2009, at 1:58 a.m.
        • A better approach?
          eXtreme Gammon -- Monday, 2 November 2009, at 2:00 a.m.
        • A better approch?
          MaX -- Monday, 2 November 2009, at 10:19 a.m.
        • A better approch?
          Mislav Radica -- Monday, 2 November 2009, at 12:55 p.m.
          • The different approachs-give us a choice
            Mislav Radica -- Monday, 2 November 2009, at 1:18 p.m.
        • A better approch?
          misja -- Monday, 2 November 2009, at 7:36 p.m.
    • A better approch?
      Neil Robins -- Tuesday, 3 November 2009, at 9:39 p.m.