<div dir="ltr">
<div>Hello everyone,</div><div><br></div><div>A handful of us have been
hard at work on an initiative to become smarter about which tests we
schedule for a given push. We are approaching our first major milestone,
a try selector that can automatically pick which tests are most
relevant to your push on your behalf. You can use it today by pulling the latest central, then running:<br></div><div><br></div><div> $ ./mach try auto</div><div><br></div><div>Running
this command will feed your patch(es) through a machine learning
algorithm that will guess which tests are most likely to be relevant.
While early results look promising, the tool is considered very
experimental. So we'd love to collect feedback from a wider developer
audience before recommending that people start using it by default.</div><div><br></div><div>Feedback we are looking for includes:</div><div><br></div><div>1.
Pushes where |mach try auto| failed to detect a regression (you either
got backed out or detected it yourself via some other means).</div><div>2.
Sentiment on resource usage. Does |mach try auto| schedule too much or
too little? How often are you willing to tolerate a backout?</div><div>3. Bug reports, especially decision task failures.</div><div>4.
Feature requests. What would you find most useful when using this
tool? For example, a flag to increase/decrease the number of tasks that
get run. Or maybe a way to explicitly choose which platforms/configurations to run on.</div><div><br></div><div>If you have any questions or would like to provide feedback, please reach out to us in <a href="https://matrix.to/#/!ahqVzULkEEXTziqCfU:mozilla.org?via=mozilla.org&via=t2bot.io" target="_blank">#test-selection:mozilla.org</a> on Matrix. You can also file bug and feature reports in <a href="https://bugzilla.mozilla.org/enter_bug.cgi?product=Firefox%20Build%20System&component=Try" target="_blank">Firefox Build System :: Try</a>.</div><div><br></div><div>Ongoing
improvements to the algorithm combined with your feedback and an ever
growing dataset to train the ML, means that |mach try auto| will
continuously improve over time. Eventually we'll recommend everyone use
it by default as well as use the same algorithm on autoland.<br></div><div><br></div><div>Thanks in advance for your help in getting us there!</div><div>-Andrew</div><div><br></div><div>p.s If you've previously tried |mach try auto| and dismissed it for running too many tasks or frequent decision task failures, please pull and give it another shot!<br></div>
</div>