7/15/2015 Flame KK v18D Gaia-ui Automation v2.2 Mozilla RIL Full Flash Build 31/45 smoketests, 115/132 non-smoketests

Lance(刘科) liuke at mgsei.com
Wed Jul 15 05:48:27 UTC 2015


Hi all,

 

Problem of wifi has caused a lot of script error. Actually after we rerun,
result of most tests is "Pass".

Because of too many errors, today's HTML report has 19M which is too large
to send by email. So html report is not attached today. To see this report,
please check the link  underneath the email. Thanks.

 


Smoketests:

Test failures - 0 replicable manually: 

 

* [Not reproduced manually] test_browser_lan.py - ScriptTimeoutException:
ScriptTimeoutException: timed out. Can’t reproduced it by Manually(0/5).

* [Not reproduced manually] test_browser_play_video.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_setup_basic_gmail.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_setup_and_send_imap_email.py - Bug 1176806
<https://bugzilla.mozilla.org/show_bug.cgi?id=1176806>  - [v2.2][Gaia::UI
Tests]test_setup_and_send_imap_email.py:"TypeError: setup_IMAP_email() takes
exactly 3 arguments (2 given)".

* [Not reproduced manually] test_IMAP_email_notification.py - Bug 1176806
<https://bugzilla.mozilla.org/show_bug.cgi?id=1176806>  - [v2.2][Gaia::UI
Tests]test_setup_and_send_imap_email.py:"TypeError: setup_IMAP_email() takes
exactly 3 arguments (2 given)".

       * [Not reproduced manually]
test_rocketbar_add_collection_save_bookmark.py - ScriptTimeoutException:
ScriptTimeoutException: timed out. Can’t reproduced it by Manually(0/5).

* [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445
<https://bugzilla.mozilla.org/show_bug.cgi?id=1134445>  - [FTU] About
Firefox OS page has "Yes! Send data." checked primarily.

       * [Not reproduced manually] test_homescreen_delete_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_homescreen_delete_app_packaged.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_homescreen_launch_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_homescreen_launch_app_packaged.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_marketplace_launch.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_marketplace_packaged_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

       * [Not reproduced manually] test_settings_wifi.py - TimeoutException:
Timed out after 30.2 seconds, caused by <class
'marionette.errors.NoSuchElementException'>. Can’t reproduced it by
Manually(0/5).

       

Expected failures / disabled tests:

       

* [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_receive_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698
<https://bugzilla.mozilla.org/show_bug.cgi?id=1061698>  - Need ability to
work in the shadow root/shadow DOM.-

* [Disabled] test_call_log_all_calls.py - Bug 1096385
<https://bugzilla.mozilla.org/show_bug.cgi?id=1096385>  - Investigate
failure in test_call_log_all_calls.py, call log is displayed erroneously.

       

Non-smoketests:

Test failures - 0 replicable manually:

 

* [Not reproduced manually] test_browser_save_image.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_navigation.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_bookmark.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_share_link.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_clear_browsing_history.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_import_contacts_from_gmail.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_sync_facebook_contacts.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_unlink_facebook.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_import_contacts_menu_no_network.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_import_gmail_no_network.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_cost_control_reset_wifi.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_rocketbar_search.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_persona_app.py - ScriptTimeoutException:
ScriptTimeoutException: timed out. Can’t reproduced it by Manually(0/5).

* [Not reproduced manually] test_findmydevice.py - ScriptTimeoutException:
ScriptTimeoutException: timed out. Can’t reproduced it by Manually(0/5).

* [Not reproduced manually] test_settings_airplane_mode.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_settings_power_save_mode.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

 

Expected failures / disabled tests:

       

* [Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop.

* [Disabled] test_settings_sim_manager.py - Test requires device with 2
sims.

* [Disabled] test_fmradio_find_stations.py - Bug 1000863
<https://bugzilla.mozilla.org/show_bug.cgi?id=1000863>  - Investigate
test_fmradio_find_stations.py failure.

* [Disabled] test_dialer_set_up_conference.py - Bug 1117813
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117813>  - Make PlivoUtil use
a valid 'answer_url' with a valid Plivo XML.

* [Expected Failure] test_call_log_groups.py - Bug 1117804
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117804>  - [v2.2] Investigate
test_call_log_groups failure.

       

Build under test:

Device firmware (base)    L1TC100118D0

Device firmware (date)    14 Jul 2015 16:24:54

Device firmware (incremental)      eng.cltbld.20150714.042442

Device firmware (release)      4.4.2

Device identifier        flame

Gaia date     09 Jul 2015 21:09:14

Gaia revision       84d0c76370dc

Gecko build 20150714002501

Gecko revision    a5db6d9850f6

Gecko version     37.0

 

Summary:
Smoketests:

45 tests ran in 4097 seconds.

31 passed, 130 skipped, 0 failed, 14 errors.

0 expected failures, 0 unexpected passes.

 

Non-smoketests:

132 tests ran in 9963 seconds.

115 passed, 55 skipped, 1 failed, 16 errors.

0 expected failures, 0 unexpected passes.

 

The reports path: 

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/07/20150714002501-v2.2-f
lame/index.html

 

Best Regards!

Lance

 

cid:image001.jpg at 01CA63C3.1FDE10E0

Marigold Software Engineering Inc.
Quality Management Dep.
E-mail: liuke at mgsei.com

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150715/363071d8/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 2277 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150715/363071d8/attachment-0001.jpg>


More information about the Fxosqa-report-watchlist mailing list