07/17/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 40/44 smoketests, 105/121 non-smoketests

Peter Bylenga pbylenga at qanalydocs.com
Fri Jul 17 22:38:45 UTC 2015


*Smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke.bitbar/292/

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_dialer -- https://bugzil.la/1183710 -
   AssertionError: 'telephony' != u'none'
   - [Not reproduced manually] test_IMAP_email_notification --
   https://bugzil.la/1181273 - TimeoutException: Timed out after 60.0
   seconds
   - [Not reproduced manually] test_connect_to_wifi_via_settings_app --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_wifi_settings'
   - [Not reproduced manually] test_enable_cell_data_via_settings_app
   --NEW- https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_cell_and_data_settings'

*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/170/
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2.bitbar/169/

Test failures - 1 replicable manually:

   - [Reproduces manually] test_import_contacts_from_gmail --
   https://bugzil.la/1183301 - [aries][Flame] import of Gmail/Outlook
   contacts is broken and hoses the app
   - [Not reproduced manually]
   test_gallery_open_valid_image_file_load_transparent_background_png
-- NEW - TimeoutException:
   Timed out after 10.1 seconds
   - [Not reproduced manually] test_unlock_to_homescreen_with_passcode --
   NEW  - TimeoutException: Timed out after 10.2 seconds
   - [Not reproduced manually] test_settings_media_storage --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_media_storage_settings'
   - [Not reproduced manually] test_set_passcode_by_settings --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_screen_lock_settings'
   - [Not reproduced manually] test_that_device_info_is_populated --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_device_info_settings'
   - [Not reproduced manually] test_settings_battery_power_save_mode --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_battery_settings'
   - [Not reproduced manually] test_settings_change_ring_tone --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_sound_settings'
   - [Not reproduced manually] test_browser_clear_history --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_browsing_privacy_settings'
   - [Not reproduced manually] test_rocketbar_offline_behavior --
   https://bugzil.la/1178859 - IOError: Connection to Marionette server is
   lost.
   - [Not reproduced manually] test_sms_create_new_contact -- NEW   -
NoSuchElementException:
   Unable to locate element: email_0
   - [Not reproduced manually] test_music_share_ringtone --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_sound_settings'
   - [Not reproduced manually] test_change_language_settings_rtl --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_language_settings'
   - [Not reproduced manually] test_enable_do_not_track_via_settings_app --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_do_not_track_settings'
   - [Not reproduced manually] test_change_wallpaper --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_display_settings'
   - [Not reproduced manually] test_change_keyboard_language_settings --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_keyboard_settings'
   - [Not reproduced manually]test_power_save_mode --NEW-
   https://bugzil.la/1184981 - 'Settings' object has no attribute
   'open_battery_settings'


*Expected failures / disabled tests:*

   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Disabled] test_settings_change_time_format -- Bug 1144868 - Disable
   test_settings_change_time_format consistently failing because of Bug 1144686
   - [Disabled] test_settings_airplane_mode -- https://bugzil.la/1131070
   - [Disabled] test_settings_bluetooth -- https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_lockscreen_time_check -- Bug 1167848 - Disable
   test_lockscreen_time_check.py until bug 1141258 is fixed
   - [Disabled] test_ftu_skip_tour_desktopb2g -- Bug 1147611 - Intermittent
   failures
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously


*Build under test:*

Device firmware (base) L1TC100118D0 Device firmware (date) 17 Jul 2015
08:49:31 Device firmware (incremental) eng.cltbld.20150717.044919 Device
firmware (release) 4.4.2 Device identifier flame Device memory 219772 kB Device
serial 374ecef6 Device uptime 0 days 0 hours 2 minutes 8 seconds Gaia date 16
Jul 2015 16:25:03 Gaia revision 77bc0d940bde
<https://github.com/mozilla-b2g/gaia/commit/77bc0d940bde2a5d2d4dfadfcccc6d8d77456d36>
Gecko
build 20150717010206 Gecko revision 8d262d1d0ae5
<https://hg.mozilla.org/mozilla-central/8d262d1d0ae5> Gecko version 42.0a1
*Summary:*

*Smoketests:*

177 tests ran in 5155.7 seconds.
40 passed, 133 skipped, 1 failed, 3 errors.
0 expected failures, 0 unexpected passes.
*Non-smoketests:*

128 tests ran in 5716.4 seconds.
54 passed, 64 skipped, 0 failed, 8 errors.
2 expected failures, 0 unexpected passes.

125 tests ran in 6055.6 seconds.
51 passed, 64 skipped, 0 failed, 8 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150717/55c7abf3/attachment.html>


More information about the Fxosqa-report-watchlist mailing list