7/16/2015 Flame KK v18D Gaia-ui Automation v2.2 Mozilla RIL Full Flash Build 41/45 smoketests, 127/132 non-smoketests

Lance(刘科) liuke at mgsei.com
Thu Jul 16 07:59:45 UTC 2015


Smoketests:

Test failures - 0 replicable manually: 

 

* [Not reproduced manually] test_setup_basic_gmail.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_setup_and_send_imap_email.py - Bug 1176806
<https://bugzilla.mozilla.org/show_bug.cgi?id=1176806>  - [v2.2][Gaia::UI
Tests]test_setup_and_send_imap_email.py:"TypeError: setup_IMAP_email() takes
exactly 3 arguments (2 given)".

* [Not reproduced manually] test_IMAP_email_notification.py - Bug 1176806
<https://bugzilla.mozilla.org/show_bug.cgi?id=1176806>  - [v2.2][Gaia::UI
Tests]test_setup_and_send_imap_email.py:"TypeError: setup_IMAP_email() takes
exactly 3 arguments (2 given)".

* [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445
<https://bugzilla.mozilla.org/show_bug.cgi?id=1134445>  - [FTU] About
Firefox OS page has "Yes! Send data." checked primarily.

             

Expected failures / disabled tests:

       

* [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_receive_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698
<https://bugzilla.mozilla.org/show_bug.cgi?id=1061698>  - Need ability to
work in the shadow root/shadow DOM.-

* [Disabled] test_call_log_all_calls.py - Bug 1096385
<https://bugzilla.mozilla.org/show_bug.cgi?id=1096385>  - Investigate
failure in test_call_log_all_calls.py, call log is displayed erroneously.

       

Non-smoketests:

Test failures - 0 replicable manually:

 

* [Not reproduced manually] test_import_contacts_from_gmail.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_import_contacts_menu_no_network.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_keyboard_predictive_key.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1121978>  1121978 - Test
test_keyboard_predictive_key.py is failing intermittently, wrong predictive
word is selected.

* [Not reproduced manually] test_persona_app.py - Exception: Could not get
Persona user from personatestuser.org: {u'message': u'Cannot get
email'}(0/5)

 

Expected failures / disabled tests:

       

* [Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop.

* [Disabled] test_settings_sim_manager.py - Test requires device with 2
sims.

* [Disabled] test_fmradio_find_stations.py - Bug 1000863
<https://bugzilla.mozilla.org/show_bug.cgi?id=1000863>  - Investigate
test_fmradio_find_stations.py failure.

* [Disabled] test_dialer_set_up_conference.py - Bug 1117813
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117813>  - Make PlivoUtil use
a valid 'answer_url' with a valid Plivo XML.

* [Expected Failure] test_call_log_groups.py - Bug 1117804
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117804>  - [v2.2] Investigate
test_call_log_groups failure.

       

Build under test:

Device firmware (base)    L1TC100118D0

Device firmware (date)    15 Jul 2015 16:07:49

Device firmware (incremental)      eng.cltbld.20150715.040736

Device firmware (release)      4.4.2

Device identifier        flame

Gaia date     09 Jul 2015 21:09:14

Gaia revision       84d0c76370dc

Gecko build 20150715002506

Gecko revision    a5db6d9850f6

Gecko version     37.0

 

Summary:
Smoketests:

45 tests ran in 3825 seconds.

41 passed, 130 skipped, 1 failed, 3 errors.

0 expected failures, 0 unexpected passes.

 

Non-smoketests:

132 tests ran in 9633 seconds.
127 passed, 55 skipped, 2 failed, 3 errors.
0 expected failures, 0 unexpected passes.

 

The reports path: 

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/07/20150715002506-v2.2-f
lame/index.html

 

Best Regards!

Lance

 

cid:image001.jpg at 01CA63C3.1FDE10E0

Marigold Software Engineering Inc.
Quality Management Dep.
E-mail: liuke at mgsei.com

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150716/363071d8/attachment-0003.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 2277 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150716/363071d8/attachment-0001.jpg>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150716/363071d8/attachment-0004.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150716/363071d8/attachment-0005.html>


More information about the Fxosqa-report-watchlist mailing list