06/19/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 40/43 smoketests, 124/129 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Fri Jun 19 16:41:52 UTC 2015


*Smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke.bitbar/242/

*Test failures - 2 replicable manually:*

   - [No manual error, new UI flow] test_setup_basic_gmail -
   https://bugzil.la/1174268 - NoSuchElementException: Unable to locate
   element: Passwd
   - [Reproduces manually] test_ftu_skip_tour -- https://bugzil.la/1175619
   - Timeout Exception:Cell data was not connected by FTU app
   - [Not reproduced manally] test_locksceen_unlock_to_camera_with_passcode
   -- https://bugzil.la/1176279 - NameError: global name 'GaiaTestCase' is
   not defined


*Expected failures / disabled tests:*

   - [Disabled] test_rocketbar_add_collection_save_bookmark -
   https://bugzil.la/1162112 - TimeoutException: TimeoutException: Timed
   out after 30.1 seconds
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 Make PlivoUtil use a valid 'answer_url' with a
   valid Plivo XML
   - [Disabled] test_setup_and_send_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accountsc
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_ftu_skip_tour_desktopb2g.py - Desktop Only
   - [Disabled] test_settings_bluetooth.py - Bug 1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_settings_airplane_mode.py - https://bugzil.la/1131070


*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/118/
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2.bitbar/117/


*Test failures - 0 replicable manually:*

   - [No manual error; new UI flow] test_import_contacts_from_gmail --
   https://bugzil.la/1174268 - NoSuchElementException: Unable to locate
   element: Passwd
   - [Not reproduced manually]
   test_lockscreen_unlock_to_emergency_call_screen --
   https://bugzil.la/1176279 - NameError: global name 'GaiaTestCase' is not
   defined


   - [Not reproduced manually] test_keyboard -- Does not reproduce via
   Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_settings_wallpaper -- Does not
   reproducevia Jenkins adhoc; 5/5 passing


*Expected failures / disabled tests:*

   - [Expected fail] test_lockscreen_time_check - https://bugzil.la/1157316
   - JavascriptException: TypeError: document.getElementById(...) is null
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_settings_change_time_format -
   https://bugzil.la/1141654 test_settings_change_time_format consistently
   failing, seems to hang and fail on the homescreen
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop
   - [Disabled] test_settings_bluetooth.py - https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_settings_airplane_mode.py - https://bugzil.la/1131070


*Build under test:*

Device firmware (base)     L1TC100118D0
Device firmware (date)     19 Jun 2015 10:03:19
Device firmware (incremental)     eng.cltbld.20150619.060308
Device firmware (release)     4.4.2
Device identifier     flame
Device memory     219772 kB
Device serial     356cd044
Device uptime     0 days 0 hours 2 minutes 54 seconds
Gaia date     18 Jun 2015 18:49:14
Gaia revision     a0df9c367a68
Gecko build     20150619010205
Gecko revision     2694ff2ace6a
Gecko version     41.0a1

*Summary:*

*Smoketests:*

179 tests ran in 4528.7 seconds.
40 passed, 136 skipped, 0 failed, 3 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

124 tests ran in 5808.6 seconds.
63 passed, 59 skipped, 0 failed, 0 errors.
2 expected failures, 0 unexpected passes.

126 tests ran in 5584.8 seconds.
61 passed, 59 skipped, 0 failed, 4 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150619/f809bd57/attachment.html>


More information about the Fxosqa-report-watchlist mailing list