<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 7, 2017 at 11:58 AM, Tim Spurway <span dir="ltr"><<a href="mailto:tspurway@mozilla.com" target="_blank">tspurway@mozilla.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">I can clarify this one, Jenn!<div><br></div><div>Hi Ritu, </div><div><br></div><div>We will be preffing AS ON for 100% of the population in release 57 Desktop by default. 100% rollout.</div><div><br></div><div>We will run two studies, starting immediately after release:</div><div><br></div><div><div>1) 1% Global Fx Desktop ALL USERS pref off AS to study general affect of AS on overall retention</div><div>2) 1% Global NEW USERS pref off AS to study how AS affects new user retention</div></div></div></blockquote><div><br></div><div>Thanks Tim. This sounds perfect. <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><br></div><div>cheers,</div><div>tim</div><div><br></div><div><div><blockquote type="cite"><div><div class="h5"><div>On Nov 7, 2017, at 2:40 PM, Ritu Kothari <<a href="mailto:rkothari@mozilla.com" target="_blank">rkothari@mozilla.com</a>> wrote:</div><br class="m_-7238801268467904326Apple-interchange-newline"></div></div><div><div><div class="h5"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 7, 2017 at 6:03 AM, Jenn Chaulk <span dir="ltr"><<a href="mailto:jchaulk@mozilla.com" target="_blank">jchaulk@mozilla.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div><div><div><div><div><div><div>Hello,<br><br></div>Since the last update on October 26th, the Activity Stream team has been working to finalize a solid contingency plan for FX57, and also analyzing (with the help of other experts across the org) the data available from past studies, as well as the 57 Beta Shield Study on Activity Stream Retention that is currently in flight. <br><br></div>Yesterday the confirmed details of that contingency plan, as well as the findings from the above mentioned data gathering and analysis were presented to management for review. The presentation can be reviewed here - <a href="https://docs.google.com/presentation/d/1ynPPRRtwALM8zbNxZRTAyoFFFt2UvBZfd_ANVLCEYuc/edit#slide=id.p" target="_blank">Activity Stream: 57 Go/No-Go Decision</a>.<br><br></div><div><div><div><div><div><div></div>In
summary, we had previously seen evidence in 56 Release indicating a drop
in retention for Activity Stream users vs the legacy new tab experience. Further analysis of the 56 data has suggested that these results are actually coming from missing data in the experiment
dataset, rather than from an actual drop in retention. (<b>Note </b>- the cause of this missing data is still unclear.) Also, we were unable to reproduce such a retention drop while running a similar study in 57 Beta, indicating that Activity Stream does not actually have any negative impact on user retention in FX57.<br><br></div>Upon conclusion of the presentation the recommendation from management was to proceed as follows:<br></div></div></div></div></div></div><ul><li><b>Proceed as per original plan: Activity Stream will be rolled out to 99% of the FX57 population upon release. A 1% control group will remain on the legacy experience.</b></li></ul></div></div></div></div></div></div></blockquote><div>Thanks for your email Jenn. In the past, when we've had a GO decision on features and it is a pref controlled feature, we typically go live with the pref turned ON from the moment we launch i.e. 100% rollout. In this case, are we planning to go-live with the pref for AS set to ON and planning to run a SHIELD study that turns AS off for 1% of release population?</div><div><br></div><div></div><div>Thanks,</div><div>Ritu<br></div><div> <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div><div>The team will continue to meet regularly and review early data from release, to monitor for any issues or abnormalities. If any major issues do occur the team may adjust the release parameters for FX57 (i.e., pull back to a smaller population percentage) as the situation dictates.</div></div></div><br></div>Best Regards,<br></div>Jenn<span class="m_-7238801268467904326HOEnZb"><font color="#888888"><br clear="all"><div><div><div><div><div><div><div><div><div><div><div><div><br>-- <br><div class="m_-7238801268467904326m_-3894516843988501108m_2056738483097333047gmail_signature"><div dir="ltr"><br>Jennifer A. Chaulk - PMP<br>Engineering Program Manager<br>Mozilla Corporation<br>Work: <a href="tel:(416)%20848-3114" value="+14168483114" target="_blank">1.416.848.3114 x 3029</a><br>Mobile: <a href="tel:(519)%20277-0365" value="+15192770365" target="_blank">519.277.0365</a><br>Email: <a href="mailto:jchaulk@mozilla.com" target="_blank">jchaulk@mozilla.com</a><br>IRC: jchaulk<br></div></div>
</div></div></div></div></div></div></div></div></div></div></div></div></font></span></div><span class="m_-7238801268467904326HOEnZb"><font color="#888888"><div><br class="m_-7238801268467904326webkit-block-placeholder"></div>
-- <br>
You received this message because you are subscribed to the Google Groups "epm-status" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:epm-status+unsubscribe@mozilla.com" target="_blank">epm-status+unsubscribe@mozilla<wbr>.com</a>.<br>
To post to this group, send email to <a href="mailto:epm-status@mozilla.com" target="_blank">epm-status@mozilla.com</a>.<br>
To view this discussion on the web visit <a href="https://groups.google.com/a/mozilla.com/d/msgid/epm-status/CAOxuPHExAVpnGKXfbNWrRJdMGoJe6CUYiev04tB8Bcp8Lv%3DSrw%40mail.gmail.com?utm_medium=email&utm_source=footer" target="_blank">https://groups.google.com/a/mo<wbr>zilla.com/d/msgid/epm-status/C<wbr>AOxuPHExAVpnGKXfbNWrRJdMGoJe6C<wbr>UYiev04tB8Bcp8Lv%3DSrw%40mail.<wbr>gmail.com</a>.<br>
</font></span></blockquote></div><br></div></div><div><br class="m_-7238801268467904326webkit-block-placeholder"></div>
-- <br></div></div>
You received this message because you are subscribed to the Google Groups "Activity Stream Team" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:activity-stream+unsubscribe@mozilla.com" target="_blank">activity-stream+unsubscribe@<wbr>mozilla.com</a>.<br>
To post to this group, send email to <a href="mailto:activity-stream@mozilla.com" target="_blank">activity-stream@mozilla.com</a>.<br>
To view this discussion on the web visit <a href="https://groups.google.com/a/mozilla.com/d/msgid/activity-stream/CAERYvbY7%2B20S9VZkoWZq4GNep4nh4sMVr4B5zJ0ddvEX-CM6Rw%40mail.gmail.com?utm_medium=email&utm_source=footer" target="_blank">https://groups.google.com/a/<wbr>mozilla.com/d/msgid/activity-<wbr>stream/CAERYvbY7%<wbr>2B20S9VZkoWZq4GNep4nh4sMVr4B5z<wbr>J0ddvEX-CM6Rw%40mail.gmail.com</a><wbr>.<br>
</div></blockquote></div><br></div></div></blockquote></div><br></div></div>