06/26/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash [Locally Run] Build 42/44 smoketests, 117/129 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Fri Jun 26 23:26:54 UTC 2015


Notes: Run locally due to https://bugzil.la/1176882, resolved fixed and
should be back on Jenkins monday.


*Smoketests:*
* attached:
** jun26_smoke.html

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_cost_control_data_alert_mobile --
   https://bugzil.la/1177553 - TimeoutException: Timed out after 20.1
   seconds
   - [Not reproduced manually] test_IMAP_email_notification -- KeyError:
   'smtp' encountered; https://bugzil.la/1176584 (maybe needs its own bug,
   but issue is identical)

*Non-smoketests:*

* attached:
** jun26_ns1.html
** jun26_adhoc_ns1.html
** jun26_ns2.html

Did not have time for manual runs, build was spun late:
*Test failures:*

   - [No manual error; different UI flow] test_sync_facebook_contacts --
   TimeoutException: Timed out after 20.1 seconds
   - [Not reproduced manually] test_fmradio_turn_on_off -- Forgot to plug
   in headphones
   - test_browser_clear_browsing_history -- Not reproduced via adhoc; 5/5
   passing
   - test_rocketbar_offline_behavior -- Reproduced via adhoc; 2/5 passing -
   NoSuchWindowException: None
   - test_gallery_share_picture -- Not reproduced via adhoc; 5/5 passing
   - test_browser_bookmark -- Reproduced via adhoc; 0/5 passing
   - test_unlink_facebook -- TimeoutException: Timed out after 20.1 seconds
   - test_homescreen_edit_mode -- MarionetteException: this.curBrowser is
   null, will investigate next week
   - test_number_keyboard -- TimeoutException: Connection timed out -->
   TimeoutException: Connection timed out
   - test_settings_device_info -- IndexError: list index out of range


*Expected failures / disabled tests:*

   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Disabled] test_settings_change_time_format -- Bug 1144868 - Disable
   test_settings_change_time_format consistently failing because of Bug 1144686
   - [Disabled] test_settings_airplane_mode -- https://bugzil.la/1131070
   - [Disabled] test_settings_bluetooth -- https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_lockscreen_time_check -- Bug 1167848 - Disable
   test_lockscreen_time_check.py until bug 1141258 is fixed
   - [Disabled] test_homescreen_column_layout -- skip-if: device == "flame"
   - [Disabled] test_ftu_skip_tour_desktopb2g -- Bug 1147611 - Intermittent
   failures
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously
   - [Disabled] test_cards_view_with_two_apps -- skip-if: device == "flame"
   - [Disabled] test_cards_view_kill_apps_with_two_apps -- skip-if: device
   == "flame"


*Build under test:*

Device firmware (base)    L1TC100118D0
Device firmware (date)    26 Jun 2015 10:24:37
Device firmware (incremental)    eng.cltbld.20150626.132424
Device firmware (release)    4.4.2
Device identifier    flame
Gaia date    24 Jun 2015 17:22:19
Gaia revision    038e91707627
Gecko build    20150626010205
Gecko revision    bbc26cc168c7
Gecko version    41.0a1

*Summary:*

*Smoketests:*

44 tests ran in 3852 seconds.
42 passed, 135 skipped, 0 failed, 2 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

65 tests ran in 6333 seconds.
57 passed, 60 skipped, 0 failed, 7 errors.
2 expected failures, 0 unexpected passes.

66 tests ran in 5210 seconds.
60 passed, 60 skipped, 0 failed, 5 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150626/238e458f/attachment-0005.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150626/238e458f/attachment-0006.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150626/238e458f/attachment-0007.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150626/238e458f/attachment-0008.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150626/238e458f/attachment-0009.html>


More information about the Fxosqa-report-watchlist mailing list