Sheriff Highlights and Summary in February 2017

Joel Maher jmaher at mozilla.com
Tue Mar 7 11:38:20 UTC 2017


One large difference I see between autoland and mozilla-inbound is that on
autoland we have many single commits/push whereas mozilla-inbound it is
fewer.  I see the Futurama data showing pushes and the sheriff report
showing total commits.  Possibly there are some more data mining
opportunities :)

On Tue, Mar 7, 2017 at 6:23 AM, David Burns <dburns at mozilla.com> wrote:

> One thing that we have also noticed is that the backout rate on autoland
> is lower than inbound.
>
> In the last 7 days backout rate is averaging (merges have been removed):
>
>    - Autoland 6%.(24 backouts out of 381 pushes)
>    - Inbound 12% (30 backouts out of 251 pushes)
>
> I don't have graphs to show this but when I look at
> https://futurama.theautomatedtester.co.uk/   each week I have seen this
> result consistenly for about a month.
>
> David
>
>
> On 7 March 2017 at 09:03, Carsten Book <cbook at mozilla.com> wrote:
>
>> Hi Lawrence,
>>
>> most (i would say 95 %) of the backouts are for Code issues - this
>> include bustages and test failures.
>>
>> From this Code Issues i would guess its about 2/3 for breaking tests and
>> 1/3 Build Bustages.
>>
>> The other backout reasons are merge conflicts / backout requests for
>> changes causes new regressions out of our test suites / backout requests
>> from developers etc -
>>
>> In February the backout rate was (excluding the servo merge with 8315
>> changesets from the 13242) = 297 in 4927 changesets = ~ 6 %
>> In January the backout rate = 302 backouts in 4121 changesets = 7 %
>>
>> We had a much higher backout rate in the past i think - so it stabilized
>> now with this 6-7 % backout rate in the last months,
>>
>> If you think its useful, i can provide for the next monthly report a more
>> detailed analysis like x % =  backouts because builds bustages, y %=
>> backouts for test failures etc .
>>
>> Cheers,
>>  -Tomcat
>>
>>
>> On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel <lmandel at mozilla.com>
>> wrote:
>>
>>> Hi Tomcat,
>>>
>>> Do you have any more details about the reasons why the 297 changesets
>>> needed to be backed out?
>>>
>>> Thanks,
>>>
>>> Lawrence
>>>
>>> On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <cbook at mozilla.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> We will be more active in 2017 and inform more about whats happening in
>>>> Sheriffing and since its already March.... :)
>>>>
>>>> In February we had about 13242 changesets landed on mozilla-central
>>>> monitored by Sheriffs.
>>>>
>>>> (The high number of changes is because of the merge from servo to
>>>> mozilla-central with about 8315 changesets).
>>>>
>>>> 297 changesets were backed out in February.
>>>>
>>>> Beside this Sheriffs took park in doing uplifts and checkin-needed bugs.
>>>>
>>>> The Current Orangefactor is 10.43 (7250 test failures failures in 695
>>>> pushes in the last 7 days).
>>>> You can find the list of top Intermittent failure bugs here
>>>> https://brasstacks.mozilla.com/orangefactor/
>>>>
>>>> You can find more statistics here: https://futurama.theautomatedt
>>>> ester.co.uk/
>>>>
>>>> A big thanks to the Team especially our Community Sheriffs for handling
>>>> the new Tier 2 Stylo Build on integration trees  and mozilla-central  and
>>>> the teamwork with the Developers!
>>>>
>>>> If you want also to be a Community Sheriffs, as part of more blogging
>>>> about Sheriffing i published a blog post about it :
>>>> https://blog.mozilla.org/tomcat/2017/02/27/community-sheriffs/
>>>>
>>>> Let us know when you have any Question or Feedback about Sheriffing.
>>>>
>>>> Cheers,
>>>>  -Tomcat
>>>>
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/firefox-dev/attachments/20170307/4eea691e/attachment.html>


More information about the firefox-dev mailing list