EOD Report for QAnalysts 01-13-2016

Kevin Tucker ktucker at qanalydocs.com
Thu Jan 14 16:52:25 UTC 2016


The team focused on smoking the b2g ota dogfood build after completing
smoke on Aries and Flame Master. Sanity, Smoke and Data Migration cases
were completed on the build and a report was sent. We also tested the
dogfood channels to ensure that whitelisting functioned properly.



*FlameKK Master Automation results:*
*Build under test:*
Device firmware (base) L1TC000118D0
Device firmware (date) 13 Jan 2016 11:35:55
Device firmware (incremental) eng.cltbld.20160113.063543
Device firmware (release) 4.4.2
Device identifier flame
Device memory 415096 kB
Device serial e472d8d7
Device uptime 0 days 0 hours 2 minutes 4 seconds
Gaia date 12 Jan 2016 17:58:29
Gaia revision a38728b06416
Gecko build 20160113030248
Gecko revision 531d1f6d1cde1182e9f7f9dff81a4fc5abc0a601
Gecko version 46.0a1

*Smoketests:*

161 tests ran in 4173.9 seconds.
37 passed, 121 skipped, 1 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

117 tests ran in 5480.4 seconds.
55 passed, 60 skipped, 2 failed, 0 errors.
0 expected failures, 0 unexpected passes.

117 tests ran in 5020.0 seconds.
51 passed, 60 skipped, 3 failed, 2 errors.
1 expected failures, 0 unexpected passes.
[image: Inline image 1]

*Aries Master Manual Smoke Test Results:*
Aries Status: Yellow*, *1 new blocker, no existing blockers

52/53 Passed

New:

- https://bugzil.la/1239389 [Aries] Spark distros are missing
* Fails [16424 <https://moztrap.mozilla.org/manage/case/16424/>]

Severe issues encountered:
mzl.la/1OZXc2b

Environmental Variables:
Device: Aries 2.6 [Full Flash]
BuildID: 20160113105518
Gaia: a38728b0641627dcd47a6f21b51fccf6ba0af58c
Gecko: da1d2c63b0686a11be1b14c6e1f76a4875bb0e64
Gonk: a19052e4389c3ae2d8fc3e7a74a475401baacc56
Version: 46.0a1 (2.6)
Firmware Version: D5803_23.1.A.1.28_NCB.ftf
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Taskcluster:
https://tools.taskcluster.net/task-inspector/#ILf_Ze_fQjemuUfI1J6lng/

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=1904593881

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8741/env/347/

[image: Inline image 2]

*FlameKK Master Manual Smoke Test Results:*

Flame 2.6 Status: Green, no blockers

54/54 passed
Severe issues encountered:
mzl.la/1PVs2WO

Environmental Variables:
Device: FlameKK 2.6 [Full Flash][512mb]
BuildID: 20160113030248
Gaia: a38728b0641627dcd47a6f21b51fccf6ba0af58c
Gecko: 531d1f6d1cde1182e9f7f9dff81a4fc5abc0a601
Gonk: 205ac4204bbbb2098a8046444acba551ba5dc75a
Version: 46.0a1 (2.6)
Firmware Version: v18D v4
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Build Location:
https://pvtbuilds.mozilla.org/pvt/mozilla.org/b2gotoro/nightly/mozilla-central-
flame-kk/2016/01/2016-01-13-03-02-48/

Daily Smoke Test Logs:
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?pli=1#gid=0

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8742/env/27835/

[image: Inline image 3]


*Aries Dogfood Testing:*
Aries Dogfood Status: Yellow*, *1 new blocker, no existing blockers

69/69 Passed
***
Dogfood Blockers:

- https://bugzil.la/1239136 Users are unable to scroll articles on yahoo.com
in browser
  * This issue doesn't explicitly fail any specific dogfood test case, but
is severe enough to impact the end user.

Severe issues encountered:
mzl.la/1OZXc2b

Build Information (OTA from build 20151230211515):
Device: Aries 2.6
BuildID: 20160113180711
Gaia: 3c97d6a8ac5a69662e1e2c22a84ea59bf50c305e
Gecko: 3283998b574d8ba48bb4d260321c6ef160d9b313
Gonk: a19052e4389c3ae2d8fc3e7a74a475401baacc56
Version: 46.0a1 (2.6)
Firmware Version: D5803_23.1.A.1.28_NCB.ftf
User Agent: Mozilla/5.0 (Mobile; rv:46.0) Gecko/46.0 Firefox/46.0

Taskcluster:
https://tools.taskcluster.net/task-inspector/#NaCadAJLQDCHI_YH6PtQgA/

Smoketest/Dogfood Test Logs:
https://docs.google.com/spreadsheets/d/111JUThDnk47kZvtiFq_DxFsAO6brrtWII6yRJ7LXUMs/edit#gid=1953402799

Moztrap Run:
https://moztrap.mozilla.org/runtests/run/8743/env/347/



*[image: Inline image 6]Exploratory Testing:*

Not much exploratory testing was done today due to dogfood testing but a
few issues were found in Calendar and Settings.

Automation, Smoke and Exploratory issues written:
mzl.la/1OQ4DqJ

[image: Inline image 4]

*QA Wanted:*

One tester was assigned to work on high severity regression windows.

*QA-Wanted completed  tasks: 0 QA-Wanted, 0 Steps wanted, and 1 Regression
Window*

Testers on QA Wanted today: 1
? or + Blockers remaining in the Queue at End-of-day: 4

*High Pri QA Wanted Tasks Completed Today: 1 task over 1 bug*
mzl.la/1Rmon7w


*Low Pri QA Wanted Tasks Completed Today: 0 tasks over 0 bugs*
*[image: Inline image 5]*Thank you

Kevin T.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 22015 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 16506 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 14715 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 12803 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0009.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 18490 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 18408 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20160114/9c8934b1/attachment-0011.png>


More information about the Fxosqa-report-watchlist mailing list