<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p><br>
</p>
<p>A couple of nice people noticed my link to the Rust coverage was
wrong:<br>
</p>
<p>Here is the main tracking bug: <br>
<a class="moz-txt-link-freetext" href="https://bugzilla.mozilla.org/show_bug.cgi?id=1335518">https://bugzilla.mozilla.org/show_bug.cgi?id=1335518</a><br>
</p>
<p>Plus Github issues tracking the specific work:<br>
<a class="moz-txt-link-freetext" href="https://github.com/rust-lang/rust/pull/38608">https://github.com/rust-lang/rust/pull/38608</a><br>
<a class="moz-txt-link-freetext" href="https://github.com/rust-lang/rust/pull/42433">https://github.com/rust-lang/rust/pull/42433</a><br>
<br>
</p>
<br>
<div class="moz-cite-prefix">On 2017-06-09 15:14, Kyle Lahnakoski
wrote:<br>
</div>
<blockquote
cite="mid:81614676-6200-8a78-3099-c3bf9f4c1683@mozilla.com"
type="cite">
<meta http-equiv="content-type" content="text/html; charset=utf-8">
<br>
## Summary of the past month<br>
<br>
Coverage is enabled for nearly all tests, and scheduled every
night [1]!!<br>
<ul>
<li>All c/c++ test suites have coverage enabled and are running
nightly<br>
</li>
<li>jsvm[7] coverage is enabled, and running <br>
</li>
<li>codecov.io [2] shows the results, broken down by directory<br>
</li>
</ul>
## Complications<br>
<ul>
<li>Rust code coverage is still delayed [6]</li>
<li>There is instability in the coverage numbers due to
variability in our test runs. This is minor compared to the
large volume of coverage we are collecting, but it may impact
discriminating analysis.<br>
</li>
</ul>
## Plans for remaining Quarter<br>
<ul>
<li>Release management requires a view into how coverage is
changing over time, and relate that change to changesets and
bugs. mcastelluccio has a very rough prototype [10] <br>
</li>
<li>Work on the long tail of test suite flavors, esoteric tests,
intermittent tests, skipped tests, and operational details to
keep this whole thing running smooth [9]<br>
</li>
<li>Streamline the grcov ETL pipeline</li>
<li>Explore what else we can do with this data.<br>
</li>
<li>Put together a presentation deck, just in case someone is
interested, for AllHands. <br>
</li>
</ul>
<p>## Meetings<br>
</p>
<p>We have weekly CodeCoverage meetings, and you are welcome to
attend:<br>
</p>
<ul>
<li> <span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">When:
Held every Friday @ 11:30 EDT (08:30 PDT)</span> </li>
<li><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">Where:
Kyle's video room </span><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z
url"><a moz-do-not-send="true"
href="https://v.mozilla.com/flex.html?roomdirect.html&key=huhL8WaTwCwC">https://v.mozilla.com/flex.html?roomdirect.html&key=huhL8WaTwCwC</a></span>
</li>
<li><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z">Etherpad:
</span><span
class="author-a-fbz76zz67z1z74zz80zdz71zz75zkz90zqz78z6z82z
url"><a moz-do-not-send="true"
href="https://public.etherpad-mozilla.org/p/code_coverage_Q1_17">https://public.etherpad-mozilla.org/p/code_coverage_Q1_17</a></span>
</li>
</ul>
<p><br>
</p>
<p>## Reference<br>
</p>
<p>[1] See coverage on TH <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=ccov">https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=ccov</a></p>
<p>[1b] Example on TH: <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=e61060be36424240058f8bef4c5597f401bc8b7e&filter-searchStr=ccov">https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=e61060be36424240058f8bef4c5597f401bc8b7e&filter-searchStr=ccov</a><br>
</p>
<p>[2] codecov.io <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://codecov.io/gh/marco-c/gecko-dev">https://codecov.io/gh/marco-c/gecko-dev</a>
</p>
<p>[3] Local Coverage <a moz-do-not-send="true" rel="nofollow"
href="https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_%28or_any_other_treeherder_build">https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_(or_any_other_treeherder_build</a>)</p>
[4] iOS Coverage <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://codecov.io/gh/mozilla-mobile/firefox-ios/branch/master">https://codecov.io/gh/mozilla-mobile/firefox-ios/branch/master</a><br>
<br>
[5] User Cases <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4">https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4</a>-
<br>
<p>[6] Rust coverage <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4">https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4</a><br>
</p>
<p>[7] JSVM coverage: <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1301174">https://bugzilla.mozilla.org/show_bug.cgi?id=1301174</a></p>
<p>[8] e10s coverage example: <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6e9cefe95adc3dd281bf8e2a2f897e8f4839e51">https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6e9cefe95adc3dd281bf8e2a2f897e8f4839e51</a></p>
[9] Everything: <a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/showdependencytree.cgi?id=1278393">https://bugzilla.mozilla.org/showdependencytree.cgi?id=1278393</a><br>
<p>[10] Show coverage differences, with bug numbers: <a
moz-do-not-send="true" class="moz-txt-link-freetext"
href="https://marco-c.github.io/grcov-test/coverage_by_dir.html">https://marco-c.github.io/grcov-test/coverage_by_dir.html</a><br>
</p>
</blockquote>
<br>
</body>
</html>