<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hello firefox-dev-ians,<div><br></div><div>I've been chatting with some people on the Firefox UX team, and we have some questions about the impact the new Australis re-design will have on our users. I mean, we've put a lot of work into the design of Australis, and we have some goals for how we want it to change user behaviour, but we don't <i>know</i> whether people will react to it in the way we expect. I also believe that the engineers who have been (and are still) putting a ton of work into landing the new design in a performant way are interested in how their hard work is impacting the people who use Firefox. Finally, I believe that with a set of Telemetry probes, we can get the answers to most of those questions.</div><div><br></div><div>The <a href="https://firefox-ux.etherpad.mozilla.org/measuringaustralis">list of questions</a> we have come up with so far is:</div><div><br></div><div><div id="magicdomid4" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px; "><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people use the Menu Panel?</span></li></ul></div><div id="magicdomid5" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">vs. how many people used the orange button?</span></li></ul></div><div id="magicdomid6" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">What do people use in the Menu Panel?</span></li></ul></div><div id="magicdomid7" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-g-1qdyg40ii5ve9z122zw9" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do they use new tools that they didn't use before</span></li></ul></div><div id="magicdomid8" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-g-1glqjwj00fez122zdpjc" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">do rates of usage increase/decrease vs. pre-australis</span></li></ul></div><div id="magicdomid9" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people enter Customize Mode?</span></li></ul></div><div id="magicdomid10" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people actually customize things?</span></li></ul></div><div id="magicdomid11" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">What do they add/remove?</span></li></ul></div><div id="magicdomid12" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">How many people click "Restore Defaults"?</span></li></ul></div><div id="magicdomid13" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">How do people exit Customize Mode?</span></li></ul></div><div id="magicdomid14" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people get stuck in customize mode?</span></li></ul></div><div id="magicdomid15" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people use the Bookmark Star?</span></li></ul></div><div id="magicdomid16" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are they bookmarking more or less?</span></li></ul></div><div id="magicdomid17" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do they use the Bookmark dropdown?</span></li></ul></div><div id="magicdomid18" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-g-1glqjwj00fez122zdpjc" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">any change in usage across the different ways of getting at bookmarks?</span></li></ul></div><div id="magicdomid19" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">What do users do upon seeing the First Run page?</span></li></ul></div><div id="magicdomid20" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do users use what we're showing them on the First Run page?</span></li></ul></div><div id="magicdomid21" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people have more tabs?</span></li></ul></div><div id="magicdomid22" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Do people switch between tabs more?</span></li></ul></div><div id="magicdomid23" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Can people find the right background tab now that they're deemphasized?</span></li></ul></div><div id="magicdomid24" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">How do the answers to all of the above questions change after a week? A month?</span></li></ul></div><div id="magicdomid25" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are people using find-in-page more or less since Australis?</span></li></ul></div><div id="magicdomid26" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Ditto for everything else in the panel.</span></li></ul></div><div id="magicdomid27" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are the tab areas discriminable?</span></li></ul></div><div id="magicdomid28" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">How often do people click on a tab, and then click on a different one?</span></li></ul></div><div id="magicdomid29" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span style="background-color: transparent;"><span class="author-g-1qdyg40ii5ve9z122zw9" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; ">Usage increase or decrease of the Menu (OS X</span><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; "> and Linux! ;</span><span class="author-g-1qdyg40ii5ve9z122zw9" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; ">)</span></span></li></ul></div><div id="magicdomid31" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-g-0bourjdcn2z122zo6hfl" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are people pleased with the new look and feel?</span></li></ul></div><div id="magicdomid32" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Does this have any effect on add-ons?</span></li></ul></div><div id="magicdomid33" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Will it break people?</span></li></ul></div><div id="magicdomid34" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Where the [redacted] is the add-on bar?</span></li></ul></div><div id="magicdomid35" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are people dragging windows more or less? (We're reducing titlebar space…)</span></li></ul></div><div id="magicdomid36" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Does the rate of people detaching tabs change?</span></li></ul></div><div id="magicdomid37" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are people more angry with us/Firefox?</span></li></ul></div><div id="magicdomid38" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle;"><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">We can use Input/Feedback for this.</span></li></ul></div><div id="magicdomid39" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">Are people using more lightweight themes?</span></li></ul></div><div id="magicdomid40" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet1" style="padding: 0px; margin: 0px 0px 0px 1.5em; "><li style="padding: 0px; margin: 0px;"><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">How do people like the new style?</span></li></ul></div><div id="magicdomid41" class="" style="padding-right: 1px; line-height: 17px; "><ul class="list-bullet2" style="padding: 0px; margin: 0px 0px 0px 3em; list-style-type: circle; "><li style="padding: 0px; margin: 0px; "><span class="author-p-4876" style="cursor: auto; padding-top: 1px; padding-bottom: 1px; background-color: transparent;">This probably needs a survey, which isn't really Telemetry…</span></li></ul></div></div><div><br></div><div>I suspect there are more things we are interested in, and that some of these things aren't able to be measured through Telemetry, so any comments or additions are more than welcome!</div><div><br></div><div>So, my requests to you are as follows:</div><div><ol class="MailOutline"><li>What am I missing in that list that we want to know or are interested in?</li><li>Which items can't we get data for with Telemetry? (Bonus points if you can suggest an alternate way of answering the question!)</li><li>For the items we can measure with Telemetry, which probes do we need to add?</li><li>Am I totally off-base here? Does this sound reasonable to everyone? Does it make sense at all? (Maybe this should be #1… ;)</li></ol></div><div><br></div><div>Assuming this is something that we all feel is valuable, then once we have a reasonably final list, I'll be happy to file bugs and meta-bugs, and (once we have some data) talk to Metrics to figure out what the data is showing us. Heck, if it's not too hard to figure out, I'ld even be up for <a href="https://developer.mozilla.org/en-US/docs/Performance/Adding_a_new_Telemetry_probe">writing some of the probes</a>, but I suspect that there's more to do than I can do by myself, and so any assistance would be welcome!</div><div><div><br></div><div>Thank you all for your input,</div><div>Blake.</div></div><div apple-content-edited="true">
<font color="#7a7a7a"><span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>-- </div><div>Blake Winton UX Engineer</div><div><a href="mailto:bwinton@mozilla.com">bwinton@mozilla.com</a></div></div></span></div></span></div></span>
</font></div>
<br></body></html>