A/B Testing in Firefox for Android

[Mark Finkle]

How would we change the decision?

How would we do staged rollouts or backouts?

On Thu, Sep 3, 2015 at 4:15 PM, Eric Rescorla <ekr at rtfm.com> wrote:

>
>
> On Thu, Sep 3, 2015 at 1:11 PM, Martin Thomson <mt at mozilla.com> wrote:
>
>> On Thu, Sep 3, 2015 at 12:21 PM, Mark Finkle <mfinkle at mozilla.com> wrote:
>> > We only intend to use this when the experiment is in a code path that
>> > happens very early in application startup. We lose all ability to
>> > dynamically alter the configuration and code path if we use this
>> approach.
>> > Any changes must be landed in the client application.
>>
>>
>> I'm not sure that I understand your concern here.  If you were to
>> publish the low and high values for a given experiment, then you do
>> commit to using CRC32 (and low and high markers), but that's not a
>> problem in an of itself.  After all, you could include an indicator
>> that describes how the buckets are calculated if you wanted to allow
>> for some flexibility.
>>
>> If the concern is that you won't be able to update rapidly, I'd
>> suggest that you might want to look at pushing updates rather than
>> rely on clients polling.
>
>
> I don't follow what the issue is here either with using client-side
> decisioning.
>
> -Ekr
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/mobile-firefox-dev/attachments/20150903/e7529c86/attachment.html>