<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Have you ever been looking at a test file in Searchfox and
wondered how the test could possibly work? Then you do some more
investigation and it turns out that the test, in fact, does not
work and is disabled? Perhaps you even melodramatically threw
your hands up in the air in frustration?</p>
<p>Well, prepare to throw your hands up in excitement, because <a
class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/show_bug.cgi?id=1653986">https://bugzilla.mozilla.org/show_bug.cgi?id=1653986</a>
has landed, bringing with it the gift of info boxes at the top of
every test page!</p>
<p>Now you can know:</p>
<p>- How long your tests take to run (on average)!<br>
- How many times your tests were run in the preceding 7 days[1]!<br>
- How many times your tests were skipped in the preceding 7 days!<br>
- What skip-patterns govern the skips from your test's
mochitest.ini-style files!<br>
- What WPT disabled patterns govern the skips from your WPT test's
meta files!<br>
- How many WPT subtests defy expectations!<br>
- The wpt.fyi URL of the test you're looking at... by clicking on
the "Web Platform Tests Dashboard" link in the "Navigation" panel
on the right side of the searchfox page!<br>
</p>
<p>This information is brought to you by:</p>
<p>- The "source-test-file-metadata-test-info-all" taskcluster job
defined at
<a class="moz-txt-link-freetext"
href="https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/file-metadata.yml">https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/file-metadata.yml</a>
that provides statistics on runs, skipped runs, and (non-WPT) skip
conditions.<br>
- The <span class="transaction-comment"
data-sigil="transaction-comment" data-meta="0_19">"source-test-wpt-metadata-summary"
taskcluster job defined at
<a class="moz-txt-link-freetext"
href="https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/wpt-metadata.yml">https://searchfox.org/mozilla-central/source/taskcluster/ci/source-test/wpt-metadata.yml</a>
that derives its data from `mach wpt-metadata-summary`. (Thanks
:jgraham!)<br>
- The people who make taskcluster and the taskcluster jobs and
the testing infrastructure and the test data pipeline go!
Having been around for the tail end of the days of the tinderbox
waterfall, it is so incredibly fantastic that adding this data
to searchfox is just a matter of expressing a few task
dependencies, adding some calls to curl using a normalized URL
structure that is exposed by taskcluster/treeherder's
introspection capabilities, some JSON plumbing, and some HTML
formatting!</span></p>
<p><span class="transaction-comment"
data-sigil="transaction-comment" data-meta="0_19">Do you think
these info boxes are good, but not yet worth putting your hands
up for? But you'd like to put your hand up to volunteer to help
improve the info boxes so that you can put both your hands up in
excitement? Then put your hands up in excitement at the
prospect of putting your hand up to volunteer because that is a
thing you can do! Because:<br>
</span></p>
<p><span class="transaction-comment"
data-sigil="transaction-comment" data-meta="0_19">- Anyone can
contribute to Searchfox!<br>
- Bugs and enhancements are tracked at bugzilla.mozilla.org
under Webtools::Searchfox. You can see existing open bugs at
<a class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/buglist.cgi?product=Webtools&component=Searchfox&bug_status=__open__">https://bugzilla.mozilla.org/buglist.cgi?product=Webtools&component=Searchfox&bug_status=__open__</a>
and file new bugs at
<a class="moz-txt-link-freetext"
href="https://bugzilla.mozilla.org/enter_bug.cgi?product=Webtools&component=Searchfox">https://bugzilla.mozilla.org/enter_bug.cgi?product=Webtools&component=Searchfox</a><br>
- The source can be found at <a class="moz-txt-link-freetext"
href="https://github.com/mozsearch/mozsearch">https://github.com/mozsearch/mozsearch</a>
and the production configurations at <a
class="moz-txt-link-freetext"
href="https://github.com/mozsearch/mozsearch-mozilla">https://github.com/mozsearch/mozsearch-mozilla</a>.<br>
- You can spin up a Searchfox VM easily[2] with Vagrant and then
build the test repo quickly with a single `make build-test-repo`
that indexes the repo and starts the web server in as little as
3.4 seconds!<br>
- There's a cool "Searchfox" chatroom on <a
class="moz-txt-link-freetext" href="https://chat.mozilla.org/">https://chat.mozilla.org/</a>
where you can discuss potential enhancements to searchfox, how
you use searchfox, how you'd like to use searchfox, and where
the point of diminishing returns was probably located on the
hands up shtick.<br>
</span></p>
<p><span class="transaction-comment"
data-sigil="transaction-comment" data-meta="0_19"><br>
</span></p>
<p><span class="transaction-comment"
data-sigil="transaction-comment" data-meta="0_19">Andrew<br>
</span></p>
<p>1: Searchfox indexing jobs run once a day for branches that are
expected to change and only on demand for historical branches.
Infrequently, the indexing jobs fail, which could put Searchfox a
day or two behind the current state of things. More info at
<a class="moz-txt-link-freetext"
href="https://github.com/mozsearch/mozsearch-mozilla#how-searchfoxorg-stays-up-to-date">https://github.com/mozsearch/mozsearch-mozilla#how-searchfoxorg-stays-up-to-date</a><br>
2: Fingers crossed, but we tried really hard to sand down all the
rough edges. Computers are still involved though so YMMV, but the
members of the "Searchfox" chatroom are happy to help you out if
you run into problems!<br>
</p>
</body>
</html>