06/10/2015 Flame KK 2.2 Full Flash 319MB/v18D Smoke Test Results - 53/68 tests passed

Hermes Cheng hcheng at mozilla.com
Wed Jun 10 11:45:45 UTC 2015


​
*Test Results*
* 53 out of 68 *​​manual* tests passing
* 0 skipped
* ​1 fail (OTA)
* 14 untested (OTA)

* 45 out of 44 *auto* tests passing
* 0 skipped
* ​1 fail
*
​2 errors
* 0 reboots
* 0 crashes
​​

​​

*Existing Bugs Breaking the Smoketests:​*
- [Reproduced manually] test_rocketbar_add_collection_save_bookmark.py – 
Bug 1165370 <https://bugzilla.mozilla.org/show_bug.cgi?id=1165370>- 
Disable test_rocketbar_add_collection_save_bookmark.py until server-side 
issue are fixed.Reproduced it by Manually(3/5).
- [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445 
<https://bugzilla.mozilla.org/show_bug.cgi?id=1134445> - [FTU] About 
Firefox OS page has "Yes! Send data." checked primarily.
- [Not reproduced manually] test_sms_with_picture_attached.py - Bug 
1170941 <https://bugzilla.mozilla.org/show_bug.cgi?id=1170941> - 
[v2.2][Gaia::UI Tests]test_sms_with_picture_attached.py: 
"TimeoutException: TimeoutException: Timed out after 301.6 seconds".

- [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192> - Problems with 
ActiveSync accounts.
- [Disabled] test_receive_active_sync_email.py - Bug 1028192 
<https://bugzilla.mozilla.org/show_bug.cgi?id=1028192> - Problems with 
ActiveSync accounts.
- [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 
<https://bugzilla.mozilla.org/show_bug.cgi?id=1061698> - Need ability to 
work in the shadow root/shadow DOM.
- [Disabled] test_call_log_all_calls.py - Bug 1096385 
<https://bugzilla.mozilla.org/show_bug.cgi?id=1096385> - Investigate 
failure in test_call_log_all_calls.py, call log is displayed erroneously.

*​Tests Were Performed With: ​ *
   Build ID: 20150609081832 37.0a2 (Full Flash)
      Gecko:​ 239c59921129
       Gaia: 06edb0f8db7c2f45cde54401a8593663059861a4
       Gonk: 7129207c321e7ac6e59bfa440693669403110e8c
Base Image: v18D

*Smoketest Results:​​*
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing 
​​ 
<https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing%E2%80%8B%E2%80%8B>
*Moztrap Links:*
Run: ​ https://moztrap.mozilla.org/runtests/environment/7359/ ​​​ 
<https://moztrap.mozilla.org/runtests/environment/7359/>
​Results: https://moztrap.mozilla.org/results/cases/?filter-run=7359
Automation Reports:​
http://mozilla-twqa.github.io/Gaiatest-Reports/2015/06/20150609081832-v2.2-flame/index.html
<http://mozilla-twqa.github.io/Gaiatest-Reports/2015/05/20150505002501-v2.2-flame/index.html>
​ Sincerely,​
​FirefoxOS QA Team​​​​
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150610/af666cfe/attachment.html>


More information about the Fxosqa-report-watchlist mailing list