6/1/2015 Flame KK v18D Gaia-ui Automation v2.2 Mozilla RIL Full Flash Build 37/45 smoketests, 124/132 non-smoketests

Lance(刘科) liuke at mgsei.com
Mon Jun 1 06:58:24 UTC 2015


Smoketests:
Test failures - 0 replicable manually:

       

* [Not reproduced manually] test_setup_basic_gmail.py - TimeoutException:
TimeoutException: Timed out after 30.2 seconds. Can¡¯t reproduced it by
Manually(0/5).

* [Not reproduced manually] test_setup_and_send_imap_email.py -
TimeoutException: TimeoutException: Timed out after 30.1 seconds. Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_IMAP_email_notification.py ¨C
TimeoutException: TimeoutException: Timed out after 30.2 seconds. Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445
<https://bugzilla.mozilla.org/show_bug.cgi?id=1134445>  - [FTU] About
Firefox OS page has "Yes! Send data." checked primarily.

* [Not reproduced manually] test_marketplace_packaged_app.py - Bug 1168284
<https://bugzilla.mozilla.org/show_bug.cgi?id=1168284>  - [v2.2][Gaia::UI
Tests]test_marketplace_packaged_app.py: "TimeoutException: TimeoutException:
Timed out after 30.1 seconds".

* [Not reproduced manually] test_sms_with_attachment.py ¨C Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166632>  1166632 -
[v2.2][Gaia::UI Tests]test_sms_with_attachments.py: "TimeoutException:
TimeoutException: Timed out after 30.2 seconds".

* [Not reproduced manually] test_sms_with_picture_attached.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166330>  1166330 -
test_sms_with_picture_attached.py: "TimeoutException: TimeoutException:
Timed out after 20.3 seconds".

* [Not reproduced manually] test_music_artist_mp3.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166631>  1166631 -
[v2.2][Gaia::UI Tests]test_music_artist_mp3.py: "TimeoutException:
TimeoutException: Timed out after 30.0 seconds".

 

Expected failures / disabled tests:

 

* [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_receive_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192>  - Problems with
ActiveSync accounts.

* [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698
<https://bugzilla.mozilla.org/show_bug.cgi?id=1061698>  - Need ability to
work in the shadow root/shadow DOM.

* [Disabled] test_call_log_all_calls.py - Bug 1096385
<https://bugzilla.mozilla.org/show_bug.cgi?id=1096385>  - Investigate
failure in test_call_log_all_calls.py, call log is displayed erroneously.

       

Non-smoketests:
Test failures - 0 replicable manually:

       

       * [Not reproduced manually] test_import_contacts_from_gmail.py ¨C
NoSuchElementException: NoSuchElementException: Unable to locate element:
submit_approve_access. Can¡¯t reproduced it by Manually(0/5).

       * [Not reproduced manually] test_import_gmail_no_network.py -
NoSuchElementException: NoSuchElementException: Unable to locate element:
submit_approve_access. Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_sms_forward_sent_message.py - We don¡¯t
have the Plivo account, so we can¡¯t verify it.

* [Not reproduced manually] test_music_album_mp3.py - Bug <https://bugzilla.
mozilla.org/show_bug.cgi?id=1166631>  1166631 - [v2.2][Gaia::UI
Tests]test_music_artist_mp3.py: "TimeoutException: TimeoutException: Timed
out after 30.0 seconds".

* [Not reproduced manually] test_music_songs_3gp.py ¨C Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166631>  1166631 -
[v2.2][Gaia::UI Tests]test_music_artist_mp3.py: "TimeoutException:
TimeoutException: Timed out after 30.0 seconds".

* [Not reproduced manually] test_music_change_rating.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166631>  1166631 -
[v2.2][Gaia::UI Tests]test_music_artist_mp3.py: "TimeoutException:
TimeoutException: Timed out after 30.0 seconds".

* [Not reproduced manually] test_settings_battery_power_save_mode.py -
StaleElementException: StaleElementException: The element reference is
stale. Either the element is no longer attached to the DOM or the page has
been refreshed. Can¡¯t reproduced it by Manually(0/5).

       

Expected failures / disabled tests:

       

* [Disabled] test_ftu_skip_tour_desktopb2g.py - Test runs only on desktop.

* [Disabled] test_settings_sim_manager.py - Test requires device with 2
sims.

* [Disabled] test_fmradio_find_stations.py - Bug 1000863
<https://bugzilla.mozilla.org/show_bug.cgi?id=1000863>  - Investigate
test_fmradio_find_stations.py failure.

* [Disabled] test_dialer_set_up_conference.py - Bug 1117813
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117813>  - Make PlivoUtil use
a valid 'answer_url' with a valid Plivo XML.

* [Expected Failure] test_call_log_groups.py - Bug 1117804
<https://bugzilla.mozilla.org/show_bug.cgi?id=1117804>  - [v2.2] Investigate
test_call_log_groups failure.

       

Build under test:

Device firmware (base)    L1TC100118D0

Device firmware (date)    31 May 2015 16:09:27

Device firmware (incremental)      eng.cltbld.20150531.040918

Device firmware (release)      4.4.2

Device identifier        flame

Gaia date     30 May 2015 22:50:16

Gaia revision       0a46394dbee0

Gecko build 20150531002502

Gecko revision    ed2f6aeb1d81

Gecko version     37.0

 

Summary:
Smoketests:

45 tests ran in 3966 seconds.

37 passed, 130 skipped, 0 failed, 8 errors.

0 expected failures, 0 unexpected passes.

 

Non-smoketests:

132 tests ran in 9678 seconds.

124 passed, 55 skipped, 1 failed, 7 errors.

0 expected failures, 0 unexpected passes.

 

The reports path:

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/05/20150531002502-v2.2-f
lame/index.html

 

Best Regards!

Lance

 

cid:image001.jpg at 01CA63C3.1FDE10E0

Marigold Software Engineering Inc.
Quality Management Dep.
E-mail: liuke at mgsei.com

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150601/1ba8412a/attachment-0003.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 2277 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150601/1ba8412a/attachment-0001.jpg>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150601/1ba8412a/attachment-0004.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150601/1ba8412a/attachment-0005.html>


More information about the Fxosqa-report-watchlist mailing list