06/03/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 42/43 smoketests, 128/129 non-smoketests

Peter Bylenga pbylenga at qanalydocs.com
Wed Jun 3 23:24:47 UTC 2015


Due to issues with bitbar, we used the results from the lab in MTV.

*Smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/Mozilla%20Lab/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke/273/

*Test Failures - 0 replicable manually:*

[Not reproduced manually] test_setup_and_send_imap_email.py - Unable to
reproduce manually - https://bugzilla.mozilla.org/show_bug.cgi?id=1171231

*Expected failures / disabled tests:*

[Expected fail] test_ftu_skip_tour.TestFtu - https://bugzil.la/1134257
Default value for 'About Firefox OS, Yes! Send Data.' causing fail in
ftu_skip_tour
[Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_setup_and_send_active_sync_email.py -
https://bugzil.la/1028192 - Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - https://bugzil.la/1028192 -
Problems with ActiveSync accountsc
[Disabled] test_rocketbar_add_collection_save_bookmark -
https://bugzil.la/1162112 - TimeoutException: TimeoutException: Timed out
after 30.1 seconds
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863
Investigate test_fmradio_find_stations.py failure
[Disabled] test_ftu_skip_tour_desktopb2g.py - Desktop Only
[Disabled] test_lockscreen_time_check.py - https://bugzil.la/1141258
disabled until bug fixed
[Disabled] test_settings_bluetooth.py - Bug 1134244 -
test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
bluetooth_settings.enable_visible_to_all()
[Disabled] test_settings_airplane_mode.py - https://bugzil.la/1131070
[Disabled] test_settings_change_time_format.py - https://bugzil.la/1144686

*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1.bitbar/79/
http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2.bitbar/79/

*Test Failures - 0 Reproducible manually *

[Not reproduced manually]
test_dialer_miss_call_from_known_contact_notification.py   -
https://bugzil.la/1169332 - AssertionError: u'' != 'Missed call'

*Expected failures / disabled tests:*

[Expected fail] test_call_log_groups.TestCallLogGroups -
https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups failure
[Expected fail] test_change_language_settings_rtl -
https://bugzil.la/1137766 - Error in both test_settings_change_language
tests: exception "Element '%s' could not be foundin select wrapper"
[Expected fail] test_import_gmail_no_network.py - https://bugzil.la/1155763
-xfail
[Expected fail] test_change_language_settings - https://bugzil.la/1137766 -
Error in both test_settings_change_language tests: exception "Element '%s'
could not be foundin select wrapper"
[Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
- Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - https://bugzil.la/1028192 -
Problems with ActiveSync accounts
[Disabled] test_rocketbar_add_collection_save_bookmark -
https://bugzil.la/1162112 - TimeoutException: TimeoutException: Timed out
after 30.1 seconds
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
Investigate test_fmradio_find_stations.py failure
[Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop
[Disabled] test_lockscreen_time_check.py - https://bugzil.la/1141258
disabled until bug fixed
[Disabled] test_settings_bluetooth.py - https://bugzil.la/1134244 -
test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
bluetooth_settings.enable_visible_to_all()
[Disabled] test_settings_airplane_mode.py - https://bugzil.la/1131070
[Disabled] test_settings_change_time_format.py - https://bugzil.la/1144686


*Build under test:*

Device firmware (base) L1TC100118D0
Device firmware (date) 03 Jun 2015 08:38:58
Device firmware (incremental) eng.cltbld.20150603.043848
Device firmware (release) 4.4.2
Device identifier flame
Device memory 219772 kB
Device serial f0694085
Device uptime 0 days 0 hours 2 minutes 7 seconds
Gaia date 02 Jun 2015 19:56:25
Gaia revision 9b7ed13e0dee
Gecko build 20150603010205
Gecko revision b0a507af2b4a
Gecko version 41.0a1


*Summary:*

*Smoketest:*

179 tests ran in 4275.7 seconds.
42 passed, 135 skipped, 0 failed, 1 errors.
1 expected failures, 0 unexpected passes.

*Non-smoketests:*

126 tests ran in 6067.6 seconds.
66 passed, 58 skipped, 0 failed, 0 errors.
2 expected failures, 0 unexpected passes.

123 tests ran in 5851.4 seconds.
62 passed, 58 skipped, 1 failed, 0 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150603/ef0f3ab6/attachment.html>


More information about the Fxosqa-report-watchlist mailing list