06/01/2015 Flame KK 2.2 Full Flash 319MB/v18D Smoke Test Results - 90/112 tests passed

Eric Chang echang at mozilla.com
Mon Jun 1 10:28:32 UTC 2015


​
*Test Results*
* 53 out of 68 *​​manual* tests passing
* 0 skipped
* ​1 fail (OTA)
* 14 untested (OTA)

* 37 out of 44 *auto* tests passing
* 0 skipped
* ​0 fail
* 8
​errors
 * 0 reboots
* 0 crashes
​​

​​

*Existing Bugs Breaking the Smoketests:​*
- *Bug 1165195* <https://bugzilla.mozilla.org/show_bug.cgi?id=1165195>
- [2.1][2.2][Flame][Settings][OTA]
Can't detect update. (server side issue)

- [Not reproduced manually] test_setup_basic_gmail.py - TimeoutException:
TimeoutException: Timed out after 30.2 seconds. Can’t reproduced it by
Manually(0/5).
- [Not reproduced manually] test_setup_and_send_imap_email.py -
TimeoutException: TimeoutException: Timed out after 30.1 seconds. Can’t
reproduced it by Manually(0/5).

- [Not reproduced manually] test_IMAP_email_notification.py –
TimeoutException: TimeoutException: Timed out after 30.2 seconds. Can’t
reproduced it by Manually(0/5).
- [Not reproduced manually] test_ftu_skip_tour.py - Bug 1134445
<https://bugzilla.mozilla.org/show_bug.cgi?id=1134445> - [FTU] About
Firefox OS page has "Yes! Send data." checked primarily.

- [Not reproduced manually] test_marketplace_packaged_app.py - Bug 1146275
<https://bugzilla.mozilla.org/show_bug.cgi?id=1146275> -
test_marketplace_packaged_app.py failure.
- [Not reproduced manually] test_sms_with_attachment.py – Bug 1166632
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166632> - [v2.2][Gaia::UI
Tests]test_sms_with_attachments.py: "TimeoutException: TimeoutException:
Timed out after 30.2 seconds".
- [Not reproduced manually] test_sms_with_picture_attached.py - Bug 1166330
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166330> -
test_sms_with_picture_attached.py: "TimeoutException: TimeoutException:
Timed out after 20.3 seconds".
- [Not reproduced manually] test_music_artist_mp3.py - Bug 1166631
<https://bugzilla.mozilla.org/show_bug.cgi?id=1166631> - [v2.2][Gaia::UI
Tests]test_music_artist_mp3.py: "TimeoutException: TimeoutException: Timed
out after 30.0 seconds".

- [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=> - Problems with ActiveSync
accounts
- [Disabled] test_receive_active_sync_email.py - Bug 1028192
<https://bugzilla.mozilla.org/show_bug.cgi?id=> - Problems with ActiveSync
accounts
- [Disabled] test_cost_
​​
control_data_alert_mobile.py - Bug 1061698
<https://bugzilla.mozilla.org/show_bug.cgi?id=> - Need ability to work in
the shadow root/shadow DOM
- [Disabled] test_call_log_all_calls.py - Bug 1096385
<https://bugzilla.mozilla.org/show_bug.cgi?id=> - Investigate failure in
test_call_log_all_calls.py, call log is displayed erroneously​

*​Tests Were Performed With: ​ *
  Build ID: 20150531162502 37.0a2 (Full Flash)
     Gecko:​ 78d8b0a4303d
      Gaia: b4582cc394e0919623263997c0cdb0b4751a1403
      Gonk: 7129207c321e7ac6e59bfa440693669403110e8c
Base Image: v18D

*Smoketest Results:​​*
https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing
​​
<https://docs.google.com/spreadsheets/d/13BjtbYDVaiC6TvOAd1x-SuoYNNM8aH5-xdJS7TU3o-U/edit?usp=sharing%E2%80%8B%E2%80%8B>
*Moztrap Links:*
Run: https://moztrap.mozilla.org/runtests/environment/7334/
​Results: https://moztrap.mozilla.org/results/cases/?filter-run​=7334
<https://moztrap.mozilla.org/results/cases/?filter-run=7334>
Automation Reports:​

http://mozilla-twqa.github.io/Gaiatest-Reports/2015/05/20150531002502-v2.2-flame/index.html

Sincerely,​
​FirefoxOS QA Team​​​​
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fxosqa-report-watchlist/attachments/20150601/210bb0cc/attachment.html>


More information about the Fxosqa-report-watchlist mailing list