06/22/2015 Flame KK v18D 319 MB Gaia-ui Automation 2.2 Full Flash Smoke Test Results - 42/45 smoketests, 130/132 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Mon Jun 22 18:29:23 UTC 2015


2.2 Automation Report

*Smoketests:*

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/06/20150619002501-v2.2-flame/smoketest.html

*Test failures - 1 replicable manually:*

   - [Reproduces manually] test_ftu_skip_tour -- Bug 1134445 - [FTU] About
   Firefox OS page has "Yes! Send data." checked primarily.
   - [Not reproduced manually] test_setup_and_send_imap_email -- Failing to
   "TypeError: setup_IMAP_email() takes exactly 3 arguments (2 given)"
      - Needs additional repro
   - [Not reproduced manually] test_IMAP_email_notification -- Failing to
   "TypeError: setup_IMAP_email() takes exactly 3 arguments (2 given)"
      - Needs additional repro


*Non-smoketests:*

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/06/20150619002501-v2.2-flame/non-smoketest.html

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_call_log_groups
   - [Not reproduced manually] test_settings_battery_power_save_mode



*Expected failures / disabled tests:*

   - [Disabled] test_call_log_all_calls -- Bug 1096385 - Investigate
   failure in test_call_log_all_calls.py, call log is displayed erroneously
   - [Disabled] test_dialer_set_up_conference_call -- Bug 1117813 - Make
   PlivoUtil use a valid 'answer_url' with a valid Plivo XML
   - [Disabled] test_setup_and_send_active_sync_email -- Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_receive_active_sync_email -- Bug 1028192 - Problems
   with ActiveSync accounts
   - [Disabled] test_fmradio_find_stations -- Bug 1000863 - Investigate
   test_fmradio_find_stations.py failure
   - [Disabled] test_ftu_skip_tour_desktopb2g -- skip-if: device !=
   "desktop"
   - [Disabled] test_settings_cell_data -- skip-if: device == "desktop" ||
   device == "sp7710gaplus_gonk" || device == "flame"




*Build under test:*

Device firmware (base)     L1TC100118D0
Device firmware (date)     19 Jun 2015 16:30:02
Device firmware (incremental)     eng.cltbld.20150619.042950
Device firmware (release)     4.4.2
Device identifier     flame
Gaia date     19 Jun 2015 09:36:47
Gaia revision     1c33072e33c2
Gecko build     20150619002501
Gecko revision     5ad34a170633
Gecko version     37.0

*Summary:*

*Smoketests:*

45 tests ran in 3740 seconds.
42 passed, 130 skipped, 1 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

132 tests ran in 9574 seconds.
130 passed, 55 skipped, 1 failed, 1 errors.
0 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150622/c6f05552/attachment.html>


More information about the Fxosqa-report-watchlist mailing list