03/10/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 42/45 smoketests, 129/135 non-smoketests

Derek Harris dharris at qanalydocs.com
Tue Mar 10 18:23:39 UTC 2015


*Smoketests:*

http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.nightly.ui.functional.smoke/80/

*Test failures - 0 replicable manually:*

[Not Reproduced manually] test_cost_control_data_alert_
mobile - https://bugzil.la/1141447 [Cost Control] The title is "We’re
building a better Internet — Mozilla", not "Home of the Mozilla Project"
[Not Reproduced manually] test_sms_contact - https://bugzil.la/1141670
Intermittent failure. 9/10 passing


*Expected failures / disabled tests:*

[Reproduces manually] test_ftu_skip_tour.TestFtu - https://bugzil.la/1134257
Default value for 'About Firefox OS, Yes! Send Data.' causing fail in
ftu_skip_tour
[Disabled] test_setup_and_send_active_sync_email.py -
https://bugzil.la/1028192 - Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - https://bugzil.la/1028192 -
Problems with ActiveSync accounts
[Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863
Investigate test_fmradio_find_stations.py failure
[Disabled] test_ftu_skip_tour_desktopb2g.py - Desktop Only
[Disabled] test_homescreen_column_layout.py - https://bugzil.la/1131037
Settings OoM and placing test in unexpected location


*Non-smoketests:*

http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.1/77/

http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.nightly.ui.functional.non-smoke.2/77/

*Test failures - 0 replicable manually:*

[Not Reproduced Manually] test_keyboard_predictive_key - Did not reproduce
via local automation: 10/10 passing
[Not Reproduced Manually] test_radio_airplane_mode - Did not reproduce via
local automation: 10/10 passing
[Not Reproduced Manually] test_settings_change_time_format -
https://bugzil.la/1141654 test_settings_change_time_format consistently
failing, seems to hang and fail on the homescreen

*Expected failures / disabled tests:*

[Expected Fail] test_call_log_groups.TestCallLogGroups -
https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups failure
[Expected Fail] test_change_language_settings_rtl -
https://bugzil.la/1137766 Exception finding Language. Reproduces via local
automation; 10/10 failing
[Expected Fail] test_change_language_settings - https://bugzil.la/1137766
Exception finding Language. Reproduces via local automation; 10/10 failing
[Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure
in test_call_log_all_calls.py, call log is displayed erroneously
[Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with
ActiveSync accounts
[Disabled] test_lockscreen_time_check.py -
https://bugzilla.mozilla.org/show_bug.cgi?id=1140027
[Disabled] test_settings_airplane_mode.py -
https://bugzilla.mozilla.org/show_bug.cgi?id=1131070
[Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
Investigate test_fmradio_find_stations.py failure
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
- Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_homescreen_column_layout.py - https://bugzil.la/1131037 -
Homescreen settings sub-menu not displayed when going to homecreen and back
[Disabled] test_settings_bluetooth.py - Bug 1134244 -
test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
bluetooth_settings.enable_visible_to_all()



*Build under test:*

Device firmware (base)    L1TC100118D0
Device firmware (date)    09 Mar 2015 01:38:47
Device firmware (incremental)    eng.cltbld.20150309.043836
Device firmware (release)    4.4.2
Device identifier    flame
Gaia date    07 Mar 2015 22:36:28
Gaia revision    fea83511df9c
Gecko build    20150309010232
Gecko revision    eab4a81e4457
Gecko version    39.0a1


*Summary:*

*Smoketests:*

45 tests ran in 4815 seconds.
42 passed, 135 skipped, 0 failed, 2 errors.
1 expected failures, 0 unexpected passes.



*Non-smoketests:*
67 tests ran in 6072 seconds.
64 passed, 58 skipped, 1 failed, 1 errors.
1 expected failures, 0 unexpected passes.

68 tests ran in 6116 seconds.
65 passed, 58 skipped, 0 failed, 1 errors.
2 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150310/0648a7e3/attachment.html>


More information about the Fxosqa-report-watchlist mailing list