<div dir="ltr"><div><div><div><div>Hi,<br><br></div>i agree with Sebastian - the integration of submitting to try and getting the results in mozreview helps i think a lot.<br><br></div>Also this is all great feedback and will add a more detailed area about backouts (where they happen like inbound/autoland, and reason) in the next sheriff monthly report.<br><br></div>Cheers,<br></div>- Tomcat<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 7, 2017 at 1:27 PM, Sebastian Hengst <span dir="ltr"><<a href="mailto:aryx@gmx.de" target="_blank">aryx@gmx.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Mozreview shows the results of Try pushes (if they have been requested) near the top where also the landing can be requested which makes it less likely that issues get missed (pushing to Try and not checking the results is not that rare).<br>
<br>
Mozreview is also the only repository to which the person who gets backed out the most (my subjection impression) pushes to (doesn't mean the second push will stick).<br>
<br>
Inbound is also often used for platform-wide changes which might have bitrotted between the Try push and the push to inbound.<br>
<br>
Sebastian<br>
<br>
-------- Original-Nachricht --------<br>
Betreff: Re: [Sheriffs] Sheriff Highlights and Summary in February 2017<br>
Von: David Burns <<a href="mailto:dburns@mozilla.com" target="_blank">dburns@mozilla.com</a>><br>
Datum: 2017-03-07 12:23<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
One thing that we have also noticed is that the backout rate on autoland is lower than inbound.<br>
<br>
In the last 7 days backout rate is averaging (merges have been removed):<br>
<br>
* Autoland 6%.(24 backouts out of 381 pushes)<br>
* Inbound 12% (30 backouts out of 251 pushes)<br>
<br>
I don't have graphs to show this but when I look at <a href="https://futurama.theautomatedtester.co.uk/" rel="noreferrer" target="_blank">https://futurama.theautomatedt<wbr>ester.co.uk/</a> <<a href="https://futurama.theautomatedtester.co.uk/" rel="noreferrer" target="_blank">https://futurama.theautomated<wbr>tester.co.uk/</a>> each week I have seen this result consistenly for about a month.<br>
<br>
David<br>
<br>
<br>
<br>
On 7 March 2017 at 09:03, Carsten Book <<a href="mailto:cbook@mozilla.com" target="_blank">cbook@mozilla.com</a> <mailto:<a href="mailto:cbook@mozilla.com" target="_blank">cbook@mozilla.com</a>>> wrote:<br>
<br>
Hi Lawrence,<br>
<br>
most (i would say 95 %) of the backouts are for Code issues - this<br>
include bustages and test failures.<br>
<br>
From this Code Issues i would guess its about 2/3 for breaking<br>
tests and 1/3 Build Bustages.<br>
<br>
The other backout reasons are merge conflicts / backout requests for<br>
changes causes new regressions out of our test suites / backout<br>
requests from developers etc -<br>
<br>
In February the backout rate was (excluding the servo merge with<br>
8315 changesets from the 13242) = 297 in 4927 changesets = ~ 6 %<br>
In January the backout rate = 302 backouts in 4121 changesets = 7 %<br>
<br>
We had a much higher backout rate in the past i think - so it<br>
stabilized now with this 6-7 % backout rate in the last months,<br>
<br>
If you think its useful, i can provide for the next monthly report a<br>
more detailed analysis like x % = backouts because builds bustages,<br>
y %= backouts for test failures etc .<br>
<br>
Cheers,<br>
-Tomcat<br>
<br>
<br>
On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel<br>
<<a href="mailto:lmandel@mozilla.com" target="_blank">lmandel@mozilla.com</a> <mailto:<a href="mailto:lmandel@mozilla.com" target="_blank">lmandel@mozilla.com</a>>> wrote:<br>
<br>
Hi Tomcat,<br>
<br>
Do you have any more details about the reasons why the 297<br>
changesets needed to be backed out?<br>
<br>
Thanks,<br>
<br>
Lawrence<br>
<br>
On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <<a href="mailto:cbook@mozilla.com" target="_blank">cbook@mozilla.com</a><br>
<mailto:<a href="mailto:cbook@mozilla.com" target="_blank">cbook@mozilla.com</a>>> wrote:<br>
<br>
Hi,<br>
<br>
We will be more active in 2017 and inform more about whats<br>
happening in Sheriffing and since its already March.... :)<br>
<br>
In February we had about 13242 changesets landed on<br>
mozilla-central monitored by Sheriffs.<br>
<br>
(The high number of changes is because of the merge from<br>
servo to mozilla-central with about 8315 changesets).<br>
<br>
297 changesets were backed out in February.<br>
<br>
Beside this Sheriffs took park in doing uplifts and<br>
checkin-needed bugs.<br>
<br>
The Current Orangefactor is 10.43 (7250 test failures<br>
failures in 695 pushes in the last 7 days).<br>
You can find the list of top Intermittent failure bugs here<br>
<a href="https://brasstacks.mozilla.com/orangefactor/" rel="noreferrer" target="_blank">https://brasstacks.mozilla.com<wbr>/orangefactor/</a><br>
<<a href="https://brasstacks.mozilla.com/orangefactor/" rel="noreferrer" target="_blank">https://brasstacks.mozilla.co<wbr>m/orangefactor/</a>><br>
<br>
You can find more statistics here:<br>
<a href="https://futurama.theautomatedtester.co.uk/" rel="noreferrer" target="_blank">https://futurama.theautomatedt<wbr>ester.co.uk/</a><br>
<<a href="https://futurama.theautomatedtester.co.uk/" rel="noreferrer" target="_blank">https://futurama.theautomated<wbr>tester.co.uk/</a>><br>
<br>
A big thanks to the Team especially our Community Sheriffs<br>
for handling the new Tier 2 Stylo Build on integration<br>
trees and mozilla-central and the teamwork with the<br>
Developers!<br>
<br>
If you want also to be a Community Sheriffs, as part of more<br>
blogging about Sheriffing i published a blog post about it :<br>
<a href="https://blog.mozilla.org/tomcat/2017/02/27/community-sheriffs/" rel="noreferrer" target="_blank">https://blog.mozilla.org/tomca<wbr>t/2017/02/27/community-sheriff<wbr>s/</a><br>
<<a href="https://blog.mozilla.org/tomcat/2017/02/27/community-sheriffs/" rel="noreferrer" target="_blank">https://blog.mozilla.org/tomc<wbr>at/2017/02/27/community-sherif<wbr>fs/</a>><br>
<br>
Let us know when you have any Question or Feedback about<br>
Sheriffing.<br>
<br>
Cheers,<br>
-Tomcat<br>
<br>
<br>
<br>
<br>
<br>
<br>
______________________________<wbr>_________________<br>
Sheriffs mailing list<br>
<a href="mailto:Sheriffs@mozilla.org" target="_blank">Sheriffs@mozilla.org</a><br>
<a href="https://mail.mozilla.org/listinfo/sheriffs" rel="noreferrer" target="_blank">https://mail.mozilla.org/listi<wbr>nfo/sheriffs</a><br>
<br>
</blockquote>
</blockquote></div><br></div>