06/24/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash [Locally Run] Build 38/43 smoketests, 115/129 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Wed Jun 24 22:22:39 UTC 2015


** *Note:* Realizing after my local adhoc runs that my testvars files and
my test accounts (email for importing contacts, facebook friends, firefox
account email) need to be updated. Many errors occurred due to encountering
screens that the phone could not progress through due to these reasons.


*Smoketests:*
* attached:
** jun24_smoke.html
** jun24_adhoc_smoke.html

*Test failures - 0 replicable manually:*

   - [Not reproduced manually] test_cost_control_data_alert_mobile --
   TimeoutException: Timed out after 20.1 seconds attempting to reset data --
   0/5 passing
   - [Not reproduced manually] test_IMAP_email_notification -- KeyError:
   'smtp' encountered; json file may be out of date
   - [Not reproduced manually] test_fmradio_frequency_dialer -- User error
   initially, no headphones; test passed with headphones
   - [Not reproduced manually] test_homescreen_launch_app -- Not reproduced
   via adhoc; 5/5 passing
   - [Not reproduced manually]
   test_locksceen_unlock_to_camera_with_passcode --
   https://bugzil.la/1176279 - NameError: global name 'GaiaTestCase' is not
   defined


*Non-smoketests:*

* attached:
** jun24_nonsmoke1.html
** jun24_nonsmoke2.html
** jun24_adhoc_nonsmoke.html

*Test failures - 1 replicable manually:*

   - [No manual error; different UI flow] test_sync_facebook_contacts --
   TimeoutException: Timed out after 20.1 seconds;
   - [Not reproduced manually] test_fmradio_turn_on_off -- User error
   initially, no headphones; test passed with headphones
   - [Not reproduced manually] test_gallery_share_picture -- Not reproduced
   via adhoc; 5/5 passing
   - [Not reproduced manually] test_keyboard_predictive_key --
   TimeoutException: Timed out after 20.1 seconds; 4/5 passing
   - [Not reproduced manually]
   test_lockscreen_unlock_to_emergency_call_screen --
   https://bugzil.la/1176279 - NameError: global name 'GaiaTestCase' is not
   defined
   - [Not reproduced manually] test_findmydevice -- TimeoutException: Timed
   out after 20.1 seconds; Invalid Password, email account doesn't match fxa
   - [Not reproduced manually] test_import_contacts_from_gmail --
   TimeoutException: Timed out after 19.9 seconds; No friends found, need to
   find friends
   - [Not reproduced manually] test_unlink_facebook -- TimeoutException:
   Timed out after 20.1 seconds;
   - [Not reproduced manually] test_dialer_clear_miss_call_notification
   - [Not reproduced manually] test_fmradio_add_remove_from_favorites --
   User error initially, no headphones; test passed with headphones
   - [Not reproduced manually] test_fmradio_airplane_mode -- User error
   initially, no headphones; test passed with headphones
   - [Not reproduced manually] test_settings_device_info -- IndexError:
   list index out of range; reproduced via adhoc, 0/5 passing
   - [Reproduces manually] test_email_one_header_displayed --
   https://bugzil.la/1176584 - NoSuchElementException: Unable to locate
   element: #cards-view li[data-origin*="email"]


*Expected failures / disabled tests:*

   - [Expected fail] test_change_language_settings_rtl -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_change_language_settings -
   https://bugzil.la/1137766 - Error in both test_settings_change_language
   tests: exception "Element '%s' could not be foundin select wrapper"
   - [Expected fail] test_import_gmail_no_network.py -
   https://bugzil.la/1155763 -xfail
   - [Expected fail] test_call_log_groups.TestCallLogGroups -
   https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups
   failure
   - [Disabled] test_settings_change_time_format -- Bug 1144868 - Disable
   test_settings_change_time_format consistently failing because of Bug 1144686
   - [Disabled] test_settings_airplane_mode -- https://bugzil.la/1131070
   - [Disabled] test_settings_bluetooth -- https://bugzil.la/1134244 -
   test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
   bluetooth_settings.enable_visible_to_all()
   - [Disabled] test_lockscreen_time_check -- Bug 1167848 - Disable
   test_lockscreen_time_check.py until bug 1141258 is fixed
   - [Disabled] test_homescreen_column_layout -- skip-if: device == "flame"
   - [Disabled] test_ftu_skip_tour_desktopb2g -- Bug 1147611 - Intermittent
   failures
   - [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
   Investigate test_fmradio_find_stations.py failure
   - [Disabled] test_receive_active_sync_email.py -
   https://bugzil.la/1028192 - Problems with ActiveSync accounts
   - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
   Problems with ActiveSync accounts
   - [Disabled] test_dialer_set_up_conference_call.py -
   https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with
   a valid Plivo XML
   - [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
   Investigate failure in test_call_log_all_calls.py, call log is displayed
   erroneously
   - [Disabled] test_cards_view_with_two_apps -- skip-if: device == "flame"
   - [Disabled] test_cards_view_kill_apps_with_two_apps -- skip-if: device
   == "flame"


*Build under test:*

Device firmware (base)    L1TC100118D0
Device firmware (date)    24 Jun 2015 02:24:12
Device firmware (incremental)    eng.cltbld.20150624.052400
Device firmware (release)    4.4.2
Device identifier    flame
Gaia date    20 Jun 2015 13:21:42
Gaia revision    311c4e59936a
Gecko build    20150624010204
Gecko revision    be81b8d6fae9
Gecko version    41.0a1

*Summary:*

*Smoketests:*

43 tests ran in 4091 seconds.
38 passed, 136 skipped, 0 failed, 5 errors.
0 expected failures, 0 unexpected passes.

*Non-smoketest:*

65 tests ran in 5663 seconds.
57 passed, 60 skipped, 0 failed, 6 errors.
2 expected failures, 0 unexpected passes.

66 tests ran in 4658 seconds.
58 passed, 60 skipped, 1 failed, 5 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0006.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0007.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0008.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0009.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0010.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150624/2f403369/attachment-0011.html>


More information about the Fxosqa-report-watchlist mailing list