[Sheriffs] Sheriff Highlights and Summary in February 2017

Carsten Book cbook at mozilla.com
Tue Mar 7 12:47:56 UTC 2017


Hi,

i agree with Sebastian - the integration of submitting to try and getting
the results in mozreview helps i think a lot.

Also this is all great feedback and will add a more detailed area about
backouts (where they happen like inbound/autoland, and reason) in the next
sheriff monthly report.

Cheers,
- Tomcat

On Tue, Mar 7, 2017 at 1:27 PM, Sebastian Hengst <aryx at gmx.de> wrote:

> Mozreview shows the results of Try pushes (if they have been requested)
> near the top where also the landing can be requested which makes it less
> likely that issues get missed (pushing to Try and not checking the results
> is not that rare).
>
> Mozreview is also the only repository to which the person who gets backed
> out the most (my subjection impression) pushes to (doesn't mean the second
> push will stick).
>
> Inbound is also often used for platform-wide changes which might have
> bitrotted between the Try push and the push to inbound.
>
> Sebastian
>
> -------- Original-Nachricht --------
> Betreff: Re: [Sheriffs] Sheriff Highlights and Summary in February 2017
> Von: David Burns <dburns at mozilla.com>
> Datum: 2017-03-07 12:23
>
>> One thing that we have also noticed is that the backout rate on autoland
>> is lower than inbound.
>>
>> In the last 7 days backout rate is averaging (merges have been removed):
>>
>>   * Autoland 6%.(24 backouts out of 381 pushes)
>>   * Inbound 12% (30 backouts out of 251 pushes)
>>
>> I don't have graphs to show this but when I look at
>> https://futurama.theautomatedtester.co.uk/ <https://futurama.theautomated
>> tester.co.uk/>   each week I have seen this result consistenly for about
>> a month.
>>
>> David
>>
>>
>>
>> On 7 March 2017 at 09:03, Carsten Book <cbook at mozilla.com <mailto:
>> cbook at mozilla.com>> wrote:
>>
>>     Hi Lawrence,
>>
>>     most (i would say 95 %) of the backouts are for Code issues - this
>>     include bustages and test failures.
>>
>>      From this Code Issues i would guess its about 2/3 for breaking
>>     tests and 1/3 Build Bustages.
>>
>>     The other backout reasons are merge conflicts / backout requests for
>>     changes causes new regressions out of our test suites / backout
>>     requests from developers etc -
>>
>>     In February the backout rate was (excluding the servo merge with
>>     8315 changesets from the 13242) = 297 in 4927 changesets = ~ 6 %
>>     In January the backout rate = 302 backouts in 4121 changesets = 7 %
>>
>>     We had a much higher backout rate in the past i think - so it
>>     stabilized now with this 6-7 % backout rate in the last months,
>>
>>     If you think its useful, i can provide for the next monthly report a
>>     more detailed analysis like x % =  backouts because builds bustages,
>>     y %= backouts for test failures etc .
>>
>>     Cheers,
>>       -Tomcat
>>
>>
>>     On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel
>>     <lmandel at mozilla.com <mailto:lmandel at mozilla.com>> wrote:
>>
>>         Hi Tomcat,
>>
>>         Do you have any more details about the reasons why the 297
>>         changesets needed to be backed out?
>>
>>         Thanks,
>>
>>         Lawrence
>>
>>         On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <cbook at mozilla.com
>>         <mailto:cbook at mozilla.com>> wrote:
>>
>>             Hi,
>>
>>             We will be more active in 2017 and inform more about whats
>>             happening in Sheriffing and since its already March.... :)
>>
>>             In February we had about 13242 changesets landed on
>>             mozilla-central monitored by Sheriffs.
>>
>>             (The high number of changes is because of the merge from
>>             servo to mozilla-central with about 8315 changesets).
>>
>>             297 changesets were backed out in February.
>>
>>             Beside this Sheriffs took park in doing uplifts and
>>             checkin-needed bugs.
>>
>>             The Current Orangefactor is 10.43 (7250 test failures
>>             failures in 695 pushes in the last 7 days).
>>             You can find the list of top Intermittent failure bugs here
>>             https://brasstacks.mozilla.com/orangefactor/
>>             <https://brasstacks.mozilla.com/orangefactor/>
>>
>>             You can find more statistics here:
>>             https://futurama.theautomatedtester.co.uk/
>>             <https://futurama.theautomatedtester.co.uk/>
>>
>>             A big thanks to the Team especially our Community Sheriffs
>>             for handling the new Tier 2 Stylo Build on integration
>>             trees  and mozilla-central  and the teamwork with the
>>             Developers!
>>
>>             If you want also to be a Community Sheriffs, as part of more
>>             blogging about Sheriffing i published a blog post about it :
>>             https://blog.mozilla.org/tomcat/2017/02/27/community-sheriff
>> s/
>>             <https://blog.mozilla.org/tomcat/2017/02/27/community-sherif
>> fs/>
>>
>>             Let us know when you have any Question or Feedback about
>>             Sheriffing.
>>
>>             Cheers,
>>               -Tomcat
>>
>>
>>
>>
>>
>>
>> _______________________________________________
>> Sheriffs mailing list
>> Sheriffs at mozilla.org
>> https://mail.mozilla.org/listinfo/sheriffs
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/firefox-dev/attachments/20170307/c7db6cbb/attachment.html>


More information about the firefox-dev mailing list