EOD Report for QAnalysts 01-06-2016

Kevin Tucker ktucker at qanalydocs.com
Thu Jan 7 01:54:23 UTC 2016


Today, the team's primary goal was to complete FlameKK automation, Aries
and Flame master smoke test as well as test and report on the 1/05 Dogfood
build.


*FlameKK Master Automation results:*
*Build under test:*
Device firmware (base) L1TC000118D0
Device firmware (date) 06 Jan 2016 14:42:35
Device firmware (incremental) eng.cltbld.20160106.094222
Device firmware (release) 4.4.2
Device identifier flame
Device memory 415096 kB
Device serial 94fdceb7
Device uptime 0 days 0 hours 2 minutes 48 seconds
Gaia date 05 Jan 2016 17:54:39
Gaia revision 16ebbfb6ce62
Gecko build 20160106060008
Gecko revision ec25e284ca6fd536484fbb7252fbb1791b71d95f
Gecko version 46.0a1

*Smoketests:*

161 tests ran in 4377.4 seconds.
37 passed, 121 skipped, 1 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

117 tests ran in 6157.0 seconds.
52 passed, 60 skipped, 2 failed, 3 errors.
0 expected failures, 0 unexpected passes.

117 tests ran in 6037.7 seconds.
47 passed, 60 skipped, 3 failed, 6 errors.
1 expected failures, 0 unexpected passes.

Failures written today:
http://mzl.la/1RtorB3

*[image: Inline image 3]*
*Aries Master Manual Smoke Test Results:*
Aries Status: Yellow, 1 new blocker

52/53 Passed


*Smoke Test Failures:*- http://bugzil.la/1237460 Calendar events cannot
start on the day they were created
* Fails [6118 <https://moztrap.mozilla.org/manage/case/6118/>]

Severe issues encountered:
http://mzl.la/1O9cT1l

Environmental Variables:
Device: Aries 2.6 [Full Flash]
Build ID: 20160106135949
Gaia: 16ebbfb6ce62c14573982b0aa87537ef8f857047
Gecko: ec25e284ca6fd536484fbb7252fbb1791b71d95f
Gonk: a19052e4389c3ae2d8fc3e7a74a475401baacc56
Version: 46.0a1 (2.6)
Firmware Version: D5803_23.1.A.1.28_NCB.ftf
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Taskcluster:
https://tools.taskcluster.net/task-inspector/#SIFHOHl6RSKY0WPrWeJO9A/

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=1904593881

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8703/env/347/
[image: Inline image 4]
*FlameKK Master Manual Smoke Test Results:*

Due to the smoke test blocker bug 1237197, we tested this build instead of
the Flame nightly build which explains why the smoke test technically only
had 1 failure instead of 2:
https://tools.taskcluster.net/task-inspector/#WZPjdcBTRfqhWRAqkNsCXA/0

Flame 2.6 Status: Red, 2 new blockers

52/53 passed
*OTA could not be tested since this build does not exist in the channel

*Smoke Test Failures:*
- https://bugzil.la/1237197 Brick test is failing -- IOError: Connection to
Marionette server is lost.
 *Already resolved fixed by backout, Will verify in the next smoketest.
- http://bugzil.la/1237460 Calendar events cannot start on the day they
were created
* Fails [6118 <https://moztrap.mozilla.org/manage/case/6118/>]

Severe issues encountered:
http://mzl.la/1UxqyTH

Environmental Variables:
Device: Flame 2.6 [Full Flash][512 MB]
BuildID: 20160106135949
Gaia: 16ebbfb6ce62c14573982b0aa87537ef8f857047
Gecko: ec25e284ca6fd536484fbb7252fbb1791b71d95f
Gonk: 205ac4204bbbb2098a8046444acba551ba5dc75a
Version: 46.0a1 (2.6)
Firmware Version: v18D v4
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Taskcluster:
https://tools.taskcluster.net/task-inspector/#WZPjdcBTRfqhWRAqkNsCXA/0

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=0

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8704/env/27835/
[image: Inline image 5]


*Exploratory Testing:*
General exploratory testing was done around smoke test cases during smoke
on Aries, Flame and Aries Dogfood.

Automation, Smoke and Exploratory issues written:
http://mzl.la/1VKD5Er
[image: Inline image 2]


*Verified issues:*
No issues were verified today:
[image: Inline image 2]
Thank you

Kevin T
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 18105 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 24851 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 18297 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 16815 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 13318 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160106/73317277/attachment-0009.png>


More information about the Fxosqa-report-watchlist mailing list