[Sheriffs] Sheriff Highlights and Summary in February 2017

Wes Kocher wkocher at mozilla.com
Tue Mar 7 17:45:28 UTC 2017


Wonder if autoland's backout rate will go up when autoland is detached from
mozreview (letting someone autoland directly from bugzilla is in the plans,
I believe).

On Tue, Mar 7, 2017 at 4:47 AM, Carsten Book <cbook at mozilla.com> wrote:

> Hi,
>
> i agree with Sebastian - the integration of submitting to try and getting
> the results in mozreview helps i think a lot.
>
> Also this is all great feedback and will add a more detailed area about
> backouts (where they happen like inbound/autoland, and reason) in the next
> sheriff monthly report.
>
> Cheers,
> - Tomcat
>
> On Tue, Mar 7, 2017 at 1:27 PM, Sebastian Hengst <aryx at gmx.de> wrote:
>
>> Mozreview shows the results of Try pushes (if they have been requested)
>> near the top where also the landing can be requested which makes it less
>> likely that issues get missed (pushing to Try and not checking the results
>> is not that rare).
>>
>> Mozreview is also the only repository to which the person who gets backed
>> out the most (my subjection impression) pushes to (doesn't mean the second
>> push will stick).
>>
>> Inbound is also often used for platform-wide changes which might have
>> bitrotted between the Try push and the push to inbound.
>>
>> Sebastian
>>
>> -------- Original-Nachricht --------
>> Betreff: Re: [Sheriffs] Sheriff Highlights and Summary in February 2017
>> Von: David Burns <dburns at mozilla.com>
>> Datum: 2017-03-07 12:23
>>
>>> One thing that we have also noticed is that the backout rate on autoland
>>> is lower than inbound.
>>>
>>> In the last 7 days backout rate is averaging (merges have been removed):
>>>
>>>   * Autoland 6%.(24 backouts out of 381 pushes)
>>>   * Inbound 12% (30 backouts out of 251 pushes)
>>>
>>> I don't have graphs to show this but when I look at
>>> https://futurama.theautomatedtester.co.uk/ <
>>> https://futurama.theautomatedtester.co.uk/>   each week I have seen
>>> this result consistenly for about a month.
>>>
>>> David
>>>
>>>
>>>
>>> On 7 March 2017 at 09:03, Carsten Book <cbook at mozilla.com <mailto:
>>> cbook at mozilla.com>> wrote:
>>>
>>>     Hi Lawrence,
>>>
>>>     most (i would say 95 %) of the backouts are for Code issues - this
>>>     include bustages and test failures.
>>>
>>>      From this Code Issues i would guess its about 2/3 for breaking
>>>     tests and 1/3 Build Bustages.
>>>
>>>     The other backout reasons are merge conflicts / backout requests for
>>>     changes causes new regressions out of our test suites / backout
>>>     requests from developers etc -
>>>
>>>     In February the backout rate was (excluding the servo merge with
>>>     8315 changesets from the 13242) = 297 in 4927 changesets = ~ 6 %
>>>     In January the backout rate = 302 backouts in 4121 changesets = 7 %
>>>
>>>     We had a much higher backout rate in the past i think - so it
>>>     stabilized now with this 6-7 % backout rate in the last months,
>>>
>>>     If you think its useful, i can provide for the next monthly report a
>>>     more detailed analysis like x % =  backouts because builds bustages,
>>>     y %= backouts for test failures etc .
>>>
>>>     Cheers,
>>>       -Tomcat
>>>
>>>
>>>     On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel
>>>     <lmandel at mozilla.com <mailto:lmandel at mozilla.com>> wrote:
>>>
>>>         Hi Tomcat,
>>>
>>>         Do you have any more details about the reasons why the 297
>>>         changesets needed to be backed out?
>>>
>>>         Thanks,
>>>
>>>         Lawrence
>>>
>>>         On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <cbook at mozilla.com
>>>         <mailto:cbook at mozilla.com>> wrote:
>>>
>>>             Hi,
>>>
>>>             We will be more active in 2017 and inform more about whats
>>>             happening in Sheriffing and since its already March.... :)
>>>
>>>             In February we had about 13242 changesets landed on
>>>             mozilla-central monitored by Sheriffs.
>>>
>>>             (The high number of changes is because of the merge from
>>>             servo to mozilla-central with about 8315 changesets).
>>>
>>>             297 changesets were backed out in February.
>>>
>>>             Beside this Sheriffs took park in doing uplifts and
>>>             checkin-needed bugs.
>>>
>>>             The Current Orangefactor is 10.43 (7250 test failures
>>>             failures in 695 pushes in the last 7 days).
>>>             You can find the list of top Intermittent failure bugs here
>>>             https://brasstacks.mozilla.com/orangefactor/
>>>             <https://brasstacks.mozilla.com/orangefactor/>
>>>
>>>             You can find more statistics here:
>>>             https://futurama.theautomatedtester.co.uk/
>>>             <https://futurama.theautomatedtester.co.uk/>
>>>
>>>             A big thanks to the Team especially our Community Sheriffs
>>>             for handling the new Tier 2 Stylo Build on integration
>>>             trees  and mozilla-central  and the teamwork with the
>>>             Developers!
>>>
>>>             If you want also to be a Community Sheriffs, as part of more
>>>             blogging about Sheriffing i published a blog post about it :
>>>             https://blog.mozilla.org/tomcat/2017/02/27/community-sheriff
>>> s/
>>>             <https://blog.mozilla.org/tomcat/2017/02/27/community-sherif
>>> fs/>
>>>
>>>             Let us know when you have any Question or Feedback about
>>>             Sheriffing.
>>>
>>>             Cheers,
>>>               -Tomcat
>>>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Sheriffs mailing list
>>> Sheriffs at mozilla.org
>>> https://mail.mozilla.org/listinfo/sheriffs
>>>
>>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/firefox-dev/attachments/20170307/1fe4073b/attachment.html>


More information about the firefox-dev mailing list