07/23/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 29/44 smoketests, 88/121 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Thu Jul 23 21:47:08 UTC 2015


* Two big blocking bugs affecting all of smoke and non-smoke tests today:

*[Not reproduced manually] NEW - https://bugzil.la/1187015
<https://bugzil.la/1187015> - TimeoutException: Timed out after 10.1
seconds*
*Smoke:*
* test_browser_cell_data
* test_browser_lan
* test_cost_control_data_alert_mobile
* test_browser_play_video

*Non-Smoke:*
* test_browser_clear_browsing_history
* test_browser_navigation
* test_cost_control_reset_wifi
* test_rocketbar_offline_behavior
* test_browser_save_image
* test_browser_share_link
* test_rocketbar_search


*[Reproduces manually] NEW - https://bugzil.la/1186920
<https://bugzil.la/1186920> - [Contacts] Unable to open contacts
application *
*Smoke: *
* test_add_new_contact
* test_edit_contact
* test_sms_contact
* test_add_photo_to_contact

*Non-Smoke:*
* test_delete_all_contacts
* test_sort_contacts
* test_add_contact_to_favorites
* test_export_contacts_to_sdcard
* test_import_contacts_menu_no_network
* test_add_to_an_existing_contact_from_messages
* test_sms_add_contact
* test_keyboard
* test_add_to_new_contact_from_messages
* test_dialer_add_contact
* test_call_contact
* test_default_contact_image
* test_delete_contact
* test_import_contacts_from_sim
* test_import_contacts_from_sdcard
* test_import_edit_export_contact
* test_import_contacts_from_gmail -- Blocked: https://bugzil.la/1182199 -
TimeoutException: Timed out after 10.1 seconds


*Smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke.bitbar/305/

*Test failures - 1 replicable manually:*

   - [Reproduces manually] test_setup_basic_gmail -- NEW -
   https://bugzil.la/1187077 - NoSuchWindowException: None
   - [Not reproduced manually] test_camera_multiple_shots -- Not reproduced
   via Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_dialer -- https://bugzil.la/1183710 -
   AssertionError: 'telephony' != u'none'
   - [Not reproduced manually]
   test_calendar_new_event_appears_on_all_calendar_views -- Not reproduced via
   Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_setup_and_send_imap_email -- Not
   reproduced via Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_clock_create_new_alarm -- Reproduced
   via Jenkins adhoc; 4/5 passing
   - [Not reproduced manually] test_IMAP_email_notification -- Reproduced
   via Jenkins adhoc; 4/5 passing

*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/182/
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2.bitbar/181/

*Test failures - 0 replicable manually:*


   - [Not reproduced manually] test_clock_set_alarm -- Not reproduced via
   Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_inbox_to_settings -- Not reproduced via
   Jenkins adhoc; 5/5 passing
   - [Not reproduced manually] test_email_one_header_displayed -- Not
   reproduced via Jenkins adhoc; 5/5 passing
   - [Blocked manually, can't open contacts]
   test_dialer_miss_call_from_known_contact_notification -- Reproed via
   Jenkins; 3/5 passing
   - [Not tested manually] test_persona_app -- Not reproduced via Jenkins
   adhoc; 5/5 passing


   - [Not reproduced manually] test_settings_change_keyboard_language --
   NEW - https://bugzil.la/1187066 - "Timed out after 10.3 seconds"
   - [Not reproduced manually] test_gallery_edit_photo -- NEW -
   https://bugzil.la/1187056 - TimeoutException: Timed out after 10.1
   seconds
   - [Not reproduced manually]
   test_sms_notification_removed_when_sms_deleted --
   https://bugzil.la/1172618
   - [Not reproduced manually]
   test_lockscreen_unlock_to_homescreen_with_passcode --
   https://bugzil.la/1181662 - Timed out after 10.1 seconds


*Expected failures / disabled tests:*

   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Disabled] test_settings_change_time_format -- Bug 1144868 - Disable
   test_settings_change_time_format consistently failing because of Bug 1144686
   - [Disabled] test_settings_airplane_mode -- https://bugzil.la/1131070
   - [Disabled] test_settings_bluetooth -- https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_lockscreen_time_check -- Bug 1167848 - Disable
   test_lockscreen_time_check.py until bug 1141258 is fixed
   - [Disabled] test_ftu_skip_tour_desktopb2g -- Bug 1147611 - Intermittent
   failures
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously


*Build under test:*

Device firmware (base)     L1TC000118D0
Device firmware (date)     23 Jul 2015 08:24:55
Device firmware (incremental)     eng.cltbld.20150723.042443
Device firmware (release)     4.4.2
Device identifier     flame
Device memory     219772 kB
Device serial     1d9a561d
Device uptime     0 days 0 hours 2 minutes 44 seconds
Gaia date     22 Jul 2015 18:44:09
Gaia revision     f04fdbfa1943
Gecko build     20150723010205
Gecko revision     2ddec2dedced
Gecko version     42.0a1

*Summary:*

*Smoketests:*

177 tests ran in 6976.1 seconds.
29 passed, 133 skipped, 1 failed, 14 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

128 tests ran in 8883.8 seconds.
46 passed, 64 skipped, 0 failed, 16 errors.
2 expected failures, 0 unexpected passes.

125 tests ran in 8457.6 seconds.
42 passed, 64 skipped, 0 failed, 17 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150723/4abcf562/attachment.html>


More information about the Fxosqa-report-watchlist mailing list