07/02/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 41/43 smoketests, 118/123 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Thu Jul 2 18:48:20 UTC 2015


*Smoketests:*
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke.bitbar/260/

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_ftu_skip_tour --
   https://bugzil.la1179891 - TimeoutException: Timed out after 10.2
   seconds with message: No languages listed on screen
      - blocking: https://bugzil.la/1179267 - Timed out with: Send Data UI
      state should match initial internal state
   - [Not reproduced manually] test_sms_with_attachments -- Not reproduced
   via Jenkins adhoc; 5/5 passing


*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/136/
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2.bitbar/135/

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_browser_bookmark --
   https://bugzil.la/1178859 - IOError: Connection to Marionette server is
   lost.
   - [Not reproduced manualy] test_rocketbar_offline_behavior -- Reproduced
   via Jenkins adhoc; 2/5 passing
      - this appears to be encountering the issue identical with
      https://bugzil.la/1178859
   - [Not reproduced manually] test_browser_share_link -- Reproduced via
   Jenkins adhoc; 3/5 passing
      - this appears to be encountering the issue identical with
      https://bugzil.la/1178859
   - [Not reproduced manually] test_email_one_header_displayed --
   https://bugzil.la/1176584 - Intermittent due to crash; 5/5 passing by
   Jenkins adhoc
   - [Not tested manually] test_persona_app -- Not reproduced via Jenkins
   adhoc; 5/5 passing


*Expected failures / disabled tests:*

   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Disabled] test_settings_change_time_format -- Bug 1144868 - Disable
   test_settings_change_time_format consistently failing because of Bug 1144686
   - [Disabled] test_settings_airplane_mode -- https://bugzil.la/1131070
   - [Disabled] test_settings_bluetooth -- https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_lockscreen_time_check -- Bug 1167848 - Disable
   test_lockscreen_time_check.py until bug 1141258 is fixed
   - [Disabled] test_homescreen_column_layout -- skip-if: device == "flame"
   - [Disabled] test_ftu_skip_tour_desktopb2g -- Bug 1147611 - Intermittent
   failures
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously
   - [Disabled] test_cards_view_with_two_apps -- skip-if: device == "flame"
   - [Disabled] test_cards_view_kill_apps_with_two_apps -- skip-if: device
   == "flame"


*Build under test:*

Device firmware (base)     L1TC100118D0
Device firmware (date)     02 Jul 2015 08:43:16
Device firmware (incremental)     eng.cltbld.20150702.044305
Device firmware (release)     4.4.2
Device identifier     flame
Device memory     219772 kB
Device serial     f30ecc97
Device uptime     0 days 0 hours 2 minutes 17 seconds
Gaia date     01 Jul 2015 20:03:18
Gaia revision     b901c8b7be21
Gecko build     20150702010204
Gecko revision     f5e3bacfb60e
Gecko version     42.0a1

*Summary:*

*Smoketests:*

178 tests ran in 4702.9 seconds.
41 passed, 135 skipped, 0 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

128 tests ran in 6051.2 seconds.
61 passed, 63 skipped, 0 failed, 2 errors.
2 expected failures, 0 unexpected passes.

125 tests ran in 6037.4 seconds.
57 passed, 63 skipped, 0 failed, 3 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150702/ab44ad6f/attachment.html>


More information about the Fxosqa-report-watchlist mailing list