09/30/2015 Flame KK v18D-1 319 MB Gaia-ui Automation mozilla-central Mozilla RIL Full Flash Build 33/46 smoketests, 116/137 non-smoketests

Verson(熊付超) xiongfuchao at mgsei.com
Wed Sep 30 09:08:48 UTC 2015


Smoketests:
Test failures - 0 replicable manually:

       

* [Not reproduced manually] test_browser_play_video.py - Can¡¯t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_setup_basic_gmail.py - Can¡¯t reproduced it
by Manually(0/5).

* [Not reproduced manually] test_fmradio_frequency_dialer.py -  Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209562>  1209562 -
test_fmradio_frequency_dialer.py : UnicodeEncodeError: 'decimal' codec can't
encode character u'\u2068' in position 0: invalid decimal Unicode string -
Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_homescreen_delete_app.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_homescreen_delete_app_packaged.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_homescreen_launch_app.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_homescreen_launch_app_packaged.py - Can¡¯t
reproduced it by Manually(0/5)

* [Not reproduced manually] test_homescreen_status_bar_icons_visibility.py -
Bug <https://bugzilla.mozilla.org/show_bug.cgi?id=1194167>  1194167 -
[v2.5][Gaia::UI Tests]test_homescreen_status_bar_icons_visibility.py:
"AssertionError: False is not true" - Can¡¯t reproduced it by Manually(0/5)

* [Not reproduced manually] test_sms_with_attachments.py - Can¡¯t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_sms_with_picture_attached.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1169997>  1169997 -
Intermittent failure in self.data_layer.connect_to_cell_data with
test_sms_with_picture_attached.py - Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_artist_mp3.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209573>  1209573 -
test_music_artist_mp3.py : TimeoutException: TimeoutException: Timed out
after 10.2 seconds - Can¡¯t reproduced it by Manually(0/5).

 

Non-smoketests:
Test failures - 0 replicable manually:

      

* [Not reproduced manually] test_browser_save_image.py - Can¡¯t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_navigation.py - Can¡¯t reproduced
it by Manually(0/5).

* [Not reproduced manually] test_browser_clear_browsing_history.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_browser_private_navigation.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_browser_launch_from_background.py - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_login_bzlite.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1204457>  1204457 -
[v2.5][Gaia::UI Tests]test_login_bzlite.py:"KeyError: 'bugzilla'"

* [Not reproduced manually] test_logout_bzlite.py  - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1204457>  1204457 -
[v2.5][Gaia::UI Tests]test_login_bzlite.py:"KeyError: 'bugzilla'"

* [Not reproduced manually] test_import_contacts_from_gmail.py -
<https://bugzil.la/1155763> https://bugzil.la/1155763 -xfail.

* [Not reproduced manually] test_fmradio_add_remove_from_favorites -  Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209562>  1209562 -
test_fmradio_frequency_dialer.py : UnicodeEncodeError: 'decimal' codec can't
encode character u'\u2068' in position 0: invalid decimal Unicode string -
Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_spark_apps_present.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1190513>  1190513 -
test_spark_apps_present.py: Spark not available on flame builds flashed for
automatio¡¤n - Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_album_mp3.py - Bug <https://bugzilla.
mozilla.org/show_bug.cgi?id=1209573>  1209573 - test_music_artist_mp3.py :
TimeoutException: TimeoutException: Timed out after 10.2 seconds - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_empty.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209573>  1209573 -
test_music_artist_mp3.py : TimeoutException: TimeoutException: Timed out
after 10.2 seconds - Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_songs_3gp.py - Bug <https://bugzilla.
mozilla.org/show_bug.cgi?id=1209573>  1209573 - test_music_artist_mp3.py :
TimeoutException: TimeoutException: Timed out after 10.2 seconds - Can¡¯t
reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_change_rating.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209573>  1209573 -
test_music_artist_mp3.py : TimeoutException: TimeoutException: Timed out
after 10.2 seconds - Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_music_share_ringtone.py - Bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1209573>  1209573 -
test_music_artist_mp3.py : TimeoutException: TimeoutException: Timed out
after 10.2 seconds - Can¡¯t reproduced it by Manually(0/5).

* [Not reproduced manually] test_persona_app.py ¨C AssertionError - Can¡¯t
reproduced it by Manually(0/5).

Expected failures / disabled tests:

       

   * [Expected fail] test_change_language_settings_rtl.py -
https://bugzil.la/1137766 - Error in both test_settings_change_language
tests: exception "Element '%s' could not be foundin select wrapper".

   * [Expected fail] test_change_language_settings.py -
https://bugzil.la/1137766 - Error in both test_settings_change_language
tests: exception "Element '%s' could not be foundin select wrapper".

   * [Expected fail] test_import_gmail_no_network.py -
https://bugzil.la/1155763 -xfail.

   * [Expected fail] test_call_log_groups.TestCallLogGroups.py -
https://bugzil.la/1117804 - [v2.2] Investigate test_call_log_groups failure.

   * [Disabled] test_settings_change_time_format.py -- Bug 1144868 - Disable
test_settings_change_time_format consistently failing because of Bug
1144686.

   * [Disabled] test_settings_airplane_mode.py - https://bugzil.la/1131070.

   * [Disabled] test_settings_bluetooth.py - https://bugzil.la/1134244 -
test_settings_bluetooth.py:test_toggle_bluetooth_settings is failing on
bluetooth_settings.enable_visible_to_all().

   * [Disabled] test_lockscreen_time_check.py - Bug 1167848 - Disable
test_lockscreen_time_check.py until bug 1141258 is fixed.

   * [Disabled] test_ftu_skip_tour_desktopb2g.py - Bug 1147611 -
Intermittent failures.

   * [Disabled] test_fmradio_find_stations.py - https://bugzil.la/1000863 -
Investigate test_fmradio_find_stations.py failure.

   * [Disabled] test_receive_active_sync_email.py -
https://bugzil.la/1028192 - Problems with ActiveSync accounts.

   * [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 -
Problems with ActiveSync accounts.

   * [Disabled] test_dialer_set_up_conference_call.py -
https://bugzil.la/1117813 - Make PlivoUtil use a valid 'answer_url' with a
valid Plivo XM.

   * [Disabled] test_call_log_all_calls.py - https://bugzil.la/1096385 -
Investigate failure in test_call_log_all_calls.py, call log is displayed
erroneously. 

       

Build under test:

Device firmware (base)    L1TC000118D0

Device firmware (date)    30 Sep 2015 02:04:27

Device firmware (incremental)      eng.cltbld.20150929.140415

Device firmware (release)      4.4.2

Device identifier flame

Gaia date     29 Sep 2015 11:53:51

Gaia revision       f345f6a01570

Gecko build  20150929102827

Gecko revision    ccee6614fd9d18a31f263fbcfe9676b224d851aa

Gecko version     44.0a1

 

Summary:
Smoketests:

46 tests ran in 4847 seconds.

33 passed, 145 skipped, 1 failed, 10 errors.

0 expected failures, 0 unexpected passes.

 

Non-smoketests:

137 tests ran in 13078 seconds.

116 passed, 66 skipped, 0 failed, 18 errors.

2 expected failures, 0 unexpected passes.

 

Best Regards!

Verson

 



Marigold Software Engineering Inc.
Quality Management Dep.

E-mail: xiongfuchao at mgsei.com <mailto:xiongfuchao at mgsei.com> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150930/fdb256c2/attachment-0003.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 2277 bytes
Desc: not available
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150930/fdb256c2/attachment-0001.jpg>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150930/fdb256c2/attachment-0004.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150930/fdb256c2/attachment-0005.html>


More information about the Fxosqa-report-watchlist mailing list