03/04/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 44/46 smoketests, 122/137 non-smoketests

Geo Mealer gmealer at mozilla.com
Wed Mar 4 13:35:46 PST 2015


This seems like an unusually large number of failures for the
non-smoketests. I'll check the next run to see if somehow that landed on a
non-viable phone or something.

On Wed, Mar 4, 2015 at 10:55 AM, Oliver Nelson <onelson at qanalydocs.com>
wrote:

> *Smoketests:*
>
> *Test failures - 0 replicable manually:*
>
>    - [Not reproduced manually] test_receive_call_with_locked_screen - Bug
>    1097754 <https://bugzil.la1097754> Did not reproduce via local
>    automation: 10/10 passing.
>
>
> *Expected failures / disabled tests:*
>
>    - [Reproduces manually] test_ftu_skip_tour.TestFtu - Bug 1134257
>    <https://bugzil.la/1134257> Default value for 'About Firefox OS, Yes!
>    Send Data.' causing fail in ftu_skip_tour
>    - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
>    <https://bugzil.la/1028192> - Problems with ActiveSync accounts
>    - [Disabled] test_receive_active_sync_email.py - Bug 1028192
>    <https://bugzil.la/1028192> - Problems with ActiveSync accounts
>    - [Disabled] test_call_log_all_calls.py - Bug 1096385
>    <https://bugzil.la/1096385> - Investigate failure in
>    test_call_log_all_calls.py, call log is displayed erroneously
>    - [Disabled] test_dialer_set_up_conference_call.py - Bug 1117813
>    <https://bugzil.la/1117813> Make PlivoUtil use a valid 'answer_url'
>    with a valid Plivo XML
>    - [Disabled] test_fmradio_find_stations.py - Bug 1000863
>    <https://bugzil.la/1000863> Investigate test_fmradio_find_stations.py
>    failure
>    - [Disabled] test_ftu_skip_tour_desktopb2g.py - Desktop Only
>    - [Disabled] test_homescreen_column_layout.py - Bug 1131037
>    <https://bugzil.la/1131037> Settings OoM and placing test in
>    unexpected location
>
>
> *Non-smoketests:*
>
> *Test failures - 1 replicable manually:*
>
>    - [Reproduces manually] test_settings_from_inbox - Bug 1138517
>    <https://bugzil.la/1138517> UI flow change for reaching Settings in
>    Messages causing permafail; not a product failure
>    - [Not reproduced manually] test_toggle_airplane_mode - Bug 1131070
>    <https://bugzil.la/1131070> Device is not recognizing that airplane
>    mode is enabled, even though it shows that it is
>    - [Not reproduced manually] test_settings_change_time_format - Bug
>    1136156 <https://bugzil.la/1136156> Lockscreen shows incorrect time
>    format after it's modified for the first time. Bug is resolved fix, keeping
>    an eye on it for the patch to land
>    - [Not reproduced manually] test_change_language_settings - Bug 1137766
>    <https://bugzil.la/1137766> Exception finding Language. Reproduces via
>    local automation; 10/10 failing
>    - [Not reproduced manually] test_change_language_settings_rtl - Bug
>    1137766 <https://bugzil.la/1137766> Exception finding Language.
>    Reproduces via local automation; 10/10 failing
>    - [Not reproduced manually]
>    test_settings_power_save_mode.TestPowerSaveMode - Did not reproduce via
>    local automation: 10/10 passing
>    - [Not reproduced manually] test_call_contact.TestContacts - Did not
>    reproduce via local automation: 10/10 passing
>    - [Not reproduced manually]
>    test_dialer_miss_call_from_known_contact_notification - Did not reproduce
>    via local automation: 10/10 passing
>    - [Not reproduced manually] test_sms_add_number_to_existing_contact -
>    Did not reproduce via local automation: 10/10 passing
>    - [Not reproduced manually] test_sms_forward_sent_message - Did not
>    reproduce via local automation: 10/10 passing
>    - [Not reproduced manually]
>    test_sms_notification_removed_when_sms_deleted - Did not reproduce via
>    local automation: 10/10 passing
>    - [Not reproduced manually] test_settings_root - Did not reproduce via
>    local automation: 10/10 passing
>    - [Not reproduced manually]
>    test_sms_notification_removed_when_sms_deleted - Did not reproduce via
>    local automation: 10/10 passing
>
>
> *Expected failures / disabled tests:*
>
>    - [Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on
>    desktop
>    - [Disabled] test_settings_sim_manager.py - Test requires device with
>    2 sims
>    - [Disabled] test_fmradio_find_stations.py - Bug 1000863
>    <https://bugzil.la/1000863> - Investigate
>    test_fmradio_find_stations.py failure
>    - [Disabled] test_dialer_set_up_conference_call.py - Bug 1117813
>    <https://bugzil.la/1117813> - Make PlivoUtil use a valid 'answer_url'
>    with a valid Plivo XML
>    - [Disabled] test_homescreen_column_layout.py - Bug 1131037
>    <https://bugzil.la/1131037> - Homescreen settings sub-menu not
>    displayed when going to homecreen and back
>    - [Expected fail] test_call_log_groups.TestCallLogGroups - Bug 1117804
>    <https://bugzil.la/1117804> - [v2.2] Investigate test_call_log_groups
>    failure
>
>
> *Build under test:*
>
> Device firmware (base)    L1TC100118D0
> Device firmware (date)    04 Mar 2015 01:20:03
> Device firmware (incremental)    eng.cltbld.20150304.041952
> Device firmware (release)    4.4.2
> Device identifier    flame
> Gaia date    03 Mar 2015 13:58:43
> Gaia revision    3fc0ac309f5f
> Gecko build    20150304010324
> Gecko revision    c5b90c003be8
> Gecko version    39.0a1
>
>
>
> *Summary:*
> *Smoketests:*
>
> 46 tests ran in 4880 seconds.
> 44 passed, 134 skipped, 0 failed, 1 errors.
> 1 expected failures, 0 unexpected passes.
>
>
> *Non-smoketests:*
>
> 68 tests ran in 6378 seconds.
> 56 passed, 56 skipped, 2 failed, 10 errors.
> 0 expected failures, 0 unexpected passes.
>
> 69 tests ran in 6138 seconds.
> 66 passed, 56 skipped, 0 failed, 2 errors.
> 1 expected failures, 0 unexpected passes.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150304/dd956c4e/attachment.html>


More information about the Fxosqa-report-watchlist mailing list