<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>
</p>
<div class="moz-text-html" lang="x-unicode"> <br>
<br>
## Summary of Past Quarter<br>
<br>
Coverage is enabled for nearly all tests, and scheduled every push
[1]!! <br>
<ul>
<li>All c/c++ test suites have coverage enabled<br>
</li>
<li>talos coverage is enabled<br>
</li>
<li>jsvm[7] coverage is enabled, and running </li>
<li>codecov.io [2] shows the results, broken down by directory<br>
</li>
</ul>
## Plans for Q3<br>
<br>
The overall plan for Q3 is laid out in the planning document
[12]. Put simply, a **coverage differential viewer**, operating
at low resolution (per central push), has enough promise to
justify Q3 effort on CodeCoverage.<br>
<br>
## The Complications<br>
<ul>
<li>Rust code coverage is still delayed [6] - maybe by mid
quarter<br>
</li>
<li>The data volume is very large; coveralls.io and codecov.io
are having some difficulty dealing with the volume.</li>
<li>There is instability in the coverage numbers due to
variability in our test runs; think GC and telemetry logic.
Multiple coverage runs will be required to get a total
coverage number</li>
<li>Intermittents are impacting coverage reliability - we will
require a coverage health monitor to know if coverage is
"complete"<br>
</li>
</ul>
## Summary of this past June<br>
<ul>
<li><span class="author-a-8hz72z5ez70zz79z2fz65zz76z58z84z5l">upgrading
tests to use Ubuntu 16.04<br>
</span></li>
<li><span class="author-a-8hz72z5ez70zz79z2fz65zz76z58z84z5l"></span>fixing
blockers that stood in the way of rust coverage<span
class="author-a-8hz72z5ez70zz79z2fz65zz76z58z84z5l"></span>
[6]<br>
</li>
<li>enabling coverage to even more suites, like talos [10] <span
class="author-a-5wz83zxfz84zz77z1z67zfck1cz75zz75z url"></span></li>
<li><span class="author-a-8hz72z5ez70zz79z2fz65zz76z58z84z5l">adding
JavaScript to the codecov/coveralls report</span></li>
<li><span class="author-a-8hz72z5ez70zz79z2fz65zz76z58z84z5l">getting
a handle on the volume of data code coverage is producing<br>
</span></li>
</ul>
<p>## Plans for July</p>
<ul>
<li>continued work on ETL pipeline</li>
<li>enable coverage for spidermonkey [11]</li>
<li>see the first hints of Rust coverage</li>
<li>build a coverage health monitor to deal with "the
complications" (above)<br>
</li>
</ul>
## Meetings<br>
<p>We have weekly CodeCoverage meetings, and you are welcome to
attend:<br>
</p>
<ul>
<li> <span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">When:
Held every Friday @ 11:30 EDT (08:30 PDT)</span> </li>
<li><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">Where:
Kyle's video room </span><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z
url"><a
href="https://v.mozilla.com/flex.html?roomdirect.html&key=huhL8WaTwCwC">https://v.mozilla.com/flex.html?roomdirect.html&key=huhL8WaTwCwC</a></span>
</li>
<li><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">Etherpad:
</span><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z
url"><a
href="https://public.etherpad-mozilla.org/p/code_coverage_Q1_17">https://public.etherpad-mozilla.org/p/code_coverage_Q1_17</a></span>
</li>
</ul>
<p><br>
</p>
<p>## Reference<br>
</p>
<p>[1] See coverage on TH <a class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=ccov">https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=ccov</a></p>
<p>[1b] Example on TH:
<a class="moz-txt-link-freetext" href="https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=433c379d6e448dc64df25a6b4d8739c99e84d102&filter-searchStr=ccov">https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=433c379d6e448dc64df25a6b4d8739c99e84d102&filter-searchStr=ccov</a>
<a class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=e61060be36424240058f8bef4c5597f401bc8b7e&filter-searchStr=ccov"></a><br>
</p>
<p>[2] codecov.io <a class="moz-txt-link-freetext"
href="https://codecov.io/gh/marco-c/gecko-dev">https://codecov.io/gh/marco-c/gecko-dev</a>
</p>
<p>[3] Local Coverage <a rel="nofollow"
href="https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_%28or_any_other_treeherder_build">https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_(or_any_other_treeherder_build</a>)</p>
[4] iOS Coverage <a class="moz-txt-link-freetext"
href="https://codecov.io/gh/mozilla-mobile/firefox-ios/branch/master">https://codecov.io/gh/mozilla-mobile/firefox-ios/branch/master</a><br>
<br>
[5] User Cases <a class="moz-txt-link-freetext"
href="https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4">https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4</a>-
<br>
<p>[6] Rust coverage <a class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1335518">https://bugzilla.mozilla.org/show_bug.cgi?id=1335518</a>
and <a class="moz-txt-link-freetext"
href="https://github.com/rust-lang/rust/pull/42433">https://github.com/rust-lang/rust/pull/42433</a>
</p>
<p>[7] JSVM coverage: <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1301174">https://bugzilla.mozilla.org/show_bug.cgi?id=1301174</a></p>
<p>[8] e10s coverage example: <a class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6e9cefe95adc3dd281bf8e2a2f897e8f4839e51">https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6e9cefe95adc3dd281bf8e2a2f897e8f4839e51</a></p>
[9] Everything: <a class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/showdependencytree.cgi?id=1278393">https://bugzilla.mozilla.org/showdependencytree.cgi?id=1278393</a><br>
<p>[10] talos coverage: <span
class="author-a-5wz83zxfz84zz77z1z67zfck1cz75zz75z"></span><span
class="author-a-5wz83zxfz84zz77z1z67zfck1cz75zz75z url"><a
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1372324">https://bugzilla.mozilla.org/show_bug.cgi?id=1372324</a></span></p>
<p><span class="author-a-5wz83zxfz84zz77z1z67zfck1cz75zz75z url"><a
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1372324">[11]
spidermonkey coverage:
https://bugzilla.mozilla.org/show_bug.cgi?id=1362013</a></span></p>
<p><span class="author-a-5wz83zxfz84zz77z1z67zfck1cz75zz75z url"><a
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1372324">[12]
Planning document:
https://docs.google.com/document/d/1dOWi18qrudwaOThNAYoCMS3e9LzhxGUiMLLrQ_WVR9w/edit?usp=sharing</a></span><br>
</p>
<p><a class="moz-txt-link-freetext"
href="https://marco-c.github.io/grcov-test/coverage_by_dir.html"><br>
</a></p>
<p><br>
</p>
<br>
<p><a class="moz-txt-link-freetext"
href="https://marco-c.github.io/grcov-test/coverage_by_dir.html"></a><br>
</p>
</div>
</body>
</html>