03/05/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 43/46 smoketests, 126/137 non-smoketests

Oliver Nelson onelson at qanalydocs.com
Thu Mar 5 11:26:43 PST 2015


*Smoketests:*

*Test failures - 0 replicable manually:*

[Not reproduced manually] test_ftu_status_bar - Intermittent failure, 9/10
passing with local automation.
[Not reproduced manually] test_toggle_bluetooth_settings -
https://bugzil.la/1134244 UI state of visibility changes after changing
name during test


*Expected failures / disabled tests:*

[Reproduces manually] test_ftu_skip_tour.TestFtu - https://bugzil.la/1134257
Default value for 'About Firefox OS, Yes! Send Data.' causing fail in
ftu_skip_tour
[Disabled] test_setup_and_send_active_sync_email.py -
https://bugzil.la/1028192 - Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - https://bugzil.la/1028192 -
Problems with ActiveSync accounts
[Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863
Investigate test_fmradio_find_stations.py failure
[Disabled] test_ftu_skip_tour_desktopb2g.py - Desktop Only
[Disabled] test_homescreen_column_layout.py - https://bugzil.la/1131037
Settings OoM and placing test in unexpected location

*Non-smoketests:*

*Test failures - 1 replicable manually:*

[Not reproduced manually] test_sms_notification - Did not reproduce via
local automation: 10/10 passing
[Reproduces manually] test_settings_from_inbox - https://bugzil.la/1138517
UI flow change for reaching Settings in Messages causing permafail; not a
product failure
[Not reproduced manually] test_change_language_settings -
https://bugzil.la/1137766 Exception finding Language. Reproduces via local
automation; 10/10 failing
[Not reproduced manually] test_toggle_airplane_mode -
https://bugzil.la/1131070 Device is not recognizing that airplane mode is
enabled, even though it shows that it is
[Not reproduced manually] test_settings_change_time_format -
https://bugzil.la/1136156 Lockscreen shows incorrect time format after it's
modified for the first time. Bug is resolved fix, keeping an eye on it for
the patch to land
[Not reproduced manually] test_dialer_clear_miss_call_notification -
https://bugzil.la/1140017 test_dialer_clear_miss_call_notification.py is
timing out after receiving the missed call
[Not reproduced manually] test_lockscreen_time_check -
https://bugzil.la/1140027 test_lockscreen_time_check.py intermittently
fails checking the time at the lockscreen. - 14/20 fail
[Not reproduced manually] test_add_to_new_contact_from_messages - Did not
reproduce via local automation: 10/10 passing
[Not reproduced manually] test_sms_to_dialer - https://bugzil.la/1140039
test_sms_to_dialer.py is intermittently failing with a timeout.
[Not reproduced manually] test_change_language_settings_rtl -
https://bugzil.la/1137766 Exception finding Language. Reproduces via local
automation; 10/10 failing


*Expected failures / disabled tests:*

[Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously
[Disabled] test_setup_and_send_active_sync_email.py -
https://bugzil.la/1028192 - Problems with ActiveSync accounts
[Disabled] test_receive_active_sync_email.py - https://bugzil.la/1028192 -
Problems with ActiveSync accounts
[Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop
[Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
Investigate test_fmradio_find_stations.py failure
[Disabled] test_dialer_set_up_conference_call.py - https://bugzil.la/1117813
- Make PlivoUtil use a valid 'answer_url' with a valid Plivo XML
[Disabled] test_homescreen_column_layout.py - https://bugzil.la/1131037 -
Homescreen settings sub-menu not displayed when going to homecreen and back
[Expected Failure] test_call_log_groups.TestCallLogGroups -
https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups failure


*Build under test:*

Device firmware (base)     L1TC100118D0
Device firmware (date)     05 Mar 2015 01:32:30
Device firmware (incremental)     eng.cltbld.20150305.043221
Device firmware (release)     4.4.2
Device identifier     flame
Gaia date     04 Mar 2015 09:42:47
Gaia revision     eff3321ab4e6
Gecko build     20150305010212
Gecko revision     56492f7244a9
Gecko version     39.0a1


*Summary:*

*Smoketests:*

46 tests ran in 5281 seconds.
43 passed, 134 skipped, 0 failed, 3 errors.
1 expected failures, 0 unexpected passes.


*Non-smoketests:*

69 tests ran in 6050 seconds.
63 passed, 56 skipped, 1 failed, 4 errors.
1 expected failures, 0 unexpected passes.

68 tests ran in 6486 seconds.
63 passed, 56 skipped, 1 failed, 4 errors.
0 expected failures, 0 unexpected passes.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150305/bc6da8fc/attachment.html>


More information about the Fxosqa-report-watchlist mailing list