07/14/2015 Flame KK 2.2 Full Flash 319MB/v18D Smoke Test Results - 68/68 tests passed

Hermes Cheng hcheng at mozilla.com
Tue Jul 14 08:05:17 UTC 2015


*Test Results*
* 68 out of 68 *​​manual* tests passing
* 0 skipped
* ​0 fail
* 0 untested

* 31 out of 45 *auto* tests passing
* 130 skipped
* ​0 fail
*
​14 errors
 * 0 reboots
* 0 crashes

*Existing Bugs Breaking the Smoketests:​*

- [Not reproduced manually] test_setup_and_send_imap_email.py - Bug 1176806
- [v2.2][Gaia::UI Tests]test_setup_and_send_imap_email.py:"TypeError:
setup_IMAP_email() takes exactly 3 arguments (2 given)".
- [Not reproduced manually] test_IMAP_email_notification.py - Bug 1176806 -
[v2.2][Gaia::UI Tests]test_setup_and_send_imap_email.py:"TypeError:
setup_IMAP_email() takes exactly 3 arguments (2 given)".
- [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445 - [FTU]
About Firefox OS page has "Yes! Send data." checked primarily.

<<Env Wifi Issue>>
- [Not reproduced manually] test_browser_lan.py - ScriptTimeoutException:
ScriptTimeoutException: timed out. Can’t reproduced it by Manually(0/5).
- [Not reproduced manually] test_browser_play_video.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_setup_basic_gmail.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_rocketbar_add_collection_save_bookmark.py
- ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t
reproduced it by Manually(0/5).
- [Not reproduced manually] test_homescreen_delete_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_homescreen_delete_app_packaged.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_homescreen_launch_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_homescreen_launch_app_packaged.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_marketplace_launch.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_marketplace_packaged_app.py -
ScriptTimeoutException: ScriptTimeoutException: timed out. Can’t reproduced
it by Manually(0/5).
- [Not reproduced manually] test_settings_wifi.py - TimeoutException: Timed
out after 30.2 seconds, caused by <class
'marionette.errors.NoSuchElementException'>. Can’t reproduced it by
Manually(0/5).

 - [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192> - Problems with
ActiveSync accounts.
- [Disabled] test_receive_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192> - Problems with
ActiveSync accounts.
- [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698
<https://bugzilla.mozilla.org/show_bug.cgi?id=1061698> - Need ability to
work in the shadow root/shadow DOM.
- [Disabled] test_call_log_all_calls.py - Bug 1096385
<https://bugzilla.mozilla.org/show_bug.cgi?id=1096385> - Investigate
failure in test_call_log_all_calls.py, call log is displayed erroneously.

*​Tests Were Performed With: ​ *
  Build ID: 20150713002503 37.0a2 (Full Flash)
     Gecko:​ 8d59402ba85a
      Gaia: 84d0c76370dcd3d25813b00de55194730884355b
      Gonk: 7129207c321e7ac6e59bfa440693669403110e8c
Base Image: v18D

*Smoketest Results:​​*
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing
​​
<https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing%E2%80%8B%E2%80%8B>
*Moztrap Links:*
Run: https://moztrap.mozilla.org/runtests/environment/7608/
​Results: https://moztrap.mozilla.org/results/cases/?filter-run=7608
Automation Reports:​
http://mozilla-twqa.github.io/Gaiatest-Reports/2015/07/20150713002503-v2.2-flame/index.html

<http://mozilla-twqa.github.io/Gaiatest-Reports/2015/06/20150609081832-v2.2-flame/index.html>
​Sincerely,​
​FirefoxOS QA Team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150714/4e3089fc/attachment.html>


More information about the Fxosqa-report-watchlist mailing list