EOD Report for QAnalysts 01-08-2016

Kevin Tucker ktucker at qanalydocs.com
Sat Jan 9 00:11:38 UTC 2016


Today, the test team completed automation on FlameKK as well as sanity and
smoke on Aries and Flame 2.6. Our exploratory testing focused on the
following areas: Pin the web, Settings, Browser, Add-ons and OTA.

*FlameKK Master Automation results:*

*Build under test:*
Device firmware (base) L1TC000118D0
Device firmware (date) 08 Jan 2016 12:10:39
Device firmware (incremental) eng.cltbld.20160108.071027
Device firmware (release) 4.4.2
Device identifier flame
Device memory 415096 kB
Device serial 1d9a563d
Device uptime 0 days 0 hours 2 minutes 25 seconds
Gaia date 08 Jan 2016 06:35:05
Gaia revision 887a1d7f2ab6
Gecko build 20160108030231
Gecko revision 1424cdfc075d1b7e277be914488ac73e20d1c982
Gecko version 46.0a1

*Smoketests:*

161 tests ran in 4544.2 seconds.
37 passed, 121 skipped, 1 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

117 tests ran in 6313.8 seconds.
50 passed, 60 skipped, 2 failed, 5 errors.
0 expected failures, 0 unexpected passes.

117 tests ran in 5320.0 seconds.
52 passed, 60 skipped, 3 failed, 1 errors.
1 expected failures, 0 unexpected passes.

[image: Inline image 1]


*Aries Master Manual Smoke Test Results:*
Aries Status: Yellow, no new blockers, 1 existing blocker

52/53 Passed


*Smoke Test Failures:*- http://bugzil.la/1237460 Calendar events cannot
start on the day they were created
* Fails [6118 <https://moztrap.mozilla.org/manage/case/6118/>]
** This issue has been resolved by backout but is not in the current build.

Severe issues encountered:
mzl.la/1PRnpPr

Device: Aries 2.6 [Full Flash]
BuildID: 20160108142141
Gaia: 887a1d7f2ab601fc40b923b4e16e6b9b48fc982e
Gecko: 3f780f4b14acab29b16bc4141a44180a8af9dd08
Gonk: a19052e4389c3ae2d8fc3e7a74a475401baacc56
Version: 46.0a1 (2.6)
Firmware Version: D5803_23.1.A.1.28_NCB.ftf
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0
Taskcluster:
https://tools.taskcluster.net/task-inspector/#DIkLKt1JSiy1RCc-MhRXlA/

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=1904593881

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8718/env/347/
[image: Inline image 2]
*FlameKK Master Manual Smoke Test Results:*

Flame 2.6 Status: Yellow, no new blockers, 1 existing blocker

53/54 passed

*Smoke Test Failures:*
- http://bugzil.la/1237460 Calendar events cannot start on the day they
were created
* Fails [6118 <https://moztrap.mozilla.org/manage/case/6118/>]
** This issue has been resolved by backout but is still in the current
build.

Severe issues encountered:
mzl.la/1ZdveET

Environmental Variables:
Device: FlameKK 2.6 [Full Flash][512mb]
BuildID: 20160108030231
Gaia: 887a1d7f2ab601fc40b923b4e16e6b9b48fc982e
Gecko: 1424cdfc075d1b7e277be914488ac73e20d1c982
Gonk: 205ac4204bbbb2098a8046444acba551ba5dc75a
Version: 46.0a1 (2.6)
Firmware Version: v18D v4
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Build Location:
https://pvtbuilds.mozilla.org/pvt/mozilla.org/b2gotoro/nightly/mozilla-central-flame-kk/2016/01/2016-01-08-03-02-31/

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=0

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8719/env/27835/
[image: Inline image 3]

*Exploratory Testing:*
Automation, Smoke and Exploratory issues written:
mzl.la/1kTBvma
[image: Inline image 1]Thank you

Kevin T.
<https://moztrap.mozilla.org/runtests/run/8718/env/347/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160108/16ce0aa3/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 26300 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160108/16ce0aa3/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 19636 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160108/16ce0aa3/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 18414 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160108/16ce0aa3/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 19827 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160108/16ce0aa3/attachment-0007.png>


More information about the Fxosqa-report-watchlist mailing list