<div dir="ltr"><div><div><div><div>On a recent Win7 Opt bc-7 run, the following tests took over 1s each in /browser/base/content/test/general. The number at the beginning is the amount of milliseconds for the respective test.<br><br>msunu@DESKTOP-I07UH4B /c/fx<br>$ sort dump.txt -n -r<br>32413 took | browser/base/content/test/general/browser_audioTabIcon.js<br>18188 took | browser/base/content/test/general/browser_bookmark_popup.js<br>15910 took | browser/base/content/test/general/browser_parsable_script.js<br>13190 took | browser/base/content/test/general/browser_bug1299667.js<br>12157 took | browser/base/content/test/general/browser_sanitizeDialog.js<br>11302 took | browser/base/content/test/general/browser_bug553455.js<br>10983 took | browser/base/content/test/general/browser_selectpopup.js<br>10472 took | browser/base/content/test/general/browser_syncui.js<br>10422 took | browser/base/content/test/general/browser_newWindowDrop.js<br>9102 took | browser/base/content/test/general/browser_extension_permissions.js<br>8281 took | browser/base/content/test/general/browser_extension_update_background.js<br>7629 took | browser/base/content/test/general/browser_aboutHome.js<br>7479 took | browser/base/content/test/general/browser_extension_update_interactive.js<br>6518 took | browser/base/content/test/general/browser_contentSearchUI.js<br>6015 took | browser/base/content/test/general/browser_aboutAccounts.js<br>5397 took | browser/base/content/test/general/browser_contentAltClick.js<br>5077 took | browser/base/content/test/general/browser_tab_drag_drop_perwindow.js<br>4520 took | browser/base/content/test/general/browser_sanitize-timespans.js<br>4226 took | browser/base/content/test/general/browser_trackingUI_telemetry.js<br>4209 took | browser/base/content/test/general/browser_windowactivation.js<br>4094 took | browser/base/content/test/general/browser_web_channel.js<br>3408 took | browser/base/content/test/general/browser_bug676619.js<br>3148 took | browser/base/content/test/general/browser_fullscreen-window-open.js<br>3059 took | browser/base/content/test/general/browser_printpreview.js<br>2987 took | browser/base/content/test/general/browser_bug422590.js<br>2924 took | browser/base/content/test/general/browser_trackingUI_4.js<br>2893 took | browser/base/content/test/general/browser_bug575561.js<br>2878 took | browser/base/content/test/general/browser_relatedTabs.js<br>2862 took | browser/base/content/test/general/browser_ctrlTab.js<br>2859 took | browser/base/content/test/general/browser_bug590206.js<br>2763 took | browser/base/content/test/general/browser_refreshBlocker.js<br>2718 took | browser/base/content/test/general/browser_trackingUI_5.js<br>2702 took | browser/base/content/test/general/browser_trackingUI_1.js<br>2659 took | browser/base/content/test/general/browser_aboutCertError.js<br>2630 took | browser/base/content/test/general/browser_extension_sideloading.js<br>2550 took | browser/base/content/test/general/browser_storagePressure_notification.js<br>2441 took | browser/base/content/test/general/browser_ssl_error_reports.js<br>2365 took | browser/base/content/test/general/browser_temporary_permissions_navigation.js<br>2295 took | browser/base/content/test/general/browser_bug767836_perwindowpb.js<br>2279 took | browser/base/content/test/general/browser_bug495058.js<br>2185 took | browser/base/content/test/general/browser_bug763468_perwindowpb.js<br>2147 took | browser/base/content/test/general/browser_beforeunload_duplicate_dialogs.js<br>2138 took | browser/base/content/test/general/browser_newwindow_focus.js<br>2067 took | browser/base/content/test/general/browser_overflowScroll.js<br>2016 took | browser/base/content/test/general/browser_getshortcutoruri.js<br>2014 took | browser/base/content/test/general/browser_save_link_when_window_navigates.js<br>1977 took | browser/base/content/test/general/browser_bug592338.js<br>1976 took | browser/base/content/test/general/browser_save_link-perwindowpb.js<br>1895 took | browser/base/content/test/general/browser_temporary_permissions_tabs.js<br>1894 took | browser/base/content/test/general/browser_temporary_permissions.js<br>1882 took | browser/base/content/test/general/browser_documentnavigation.js<br>1855 took | browser/base/content/test/general/browser_permissions.js<br>1818 took | browser/base/content/test/general/browser_tab_dragdrop.js<br>1807 took | browser/base/content/test/general/browser_trackingUI_2.js<br>1788 took | browser/base/content/test/general/browser_parsable_css.js<br>1776 took | browser/base/content/test/general/browser_bug719271.js<br>1752 took | browser/base/content/test/general/browser_datachoices_notification.js<br>1670 took | browser/base/content/test/general/browser_newTabDrop.js<br>1670 took | browser/base/content/test/general/browser_misused_characters_in_strings.js<br>1638 took | browser/base/content/test/general/browser_tab_dragdrop2.js<br>1608 took | browser/base/content/test/general/browser_e10s_switchbrowser.js<br>1567 took | browser/base/content/test/general/browser_e10s_chrome_process.js<br>1444 took | browser/base/content/test/general/browser_contextmenu_input.js<br>1428 took | browser/base/content/test/general/browser_bug462673.js<br>1357 took | browser/base/content/test/general/browser_domFullscreen_fullscreenMode.js<br>1353 took | browser/base/content/test/general/browser_tabkeynavigation.js<br>1274 took | browser/base/content/test/general/browser_aboutHome_wrapsCorrectly.js<br>1232 took | browser/base/content/test/general/browser_private_browsing_window.js<br>1232 took | browser/base/content/test/general/browser_favicon_change_not_in_document.js<br>1213 took | browser/base/content/test/general/browser_tab_detach_restore.js<br>1129 took | browser/base/content/test/general/browser_bug735471.js<br>1087 took | browser/base/content/test/general/browser_zbug569342.js<br>1081 took | browser/base/content/test/general/browser_alltabslistener.js<br>1056 took | browser/base/content/test/general/browser_bug623893.js<br>1054 took | browser/base/content/test/general/browser_contextmenu_childprocess.js<br>1042 took | browser/base/content/test/general/browser_tabDrop.js<br>1015 took | browser/base/content/test/general/browser_offlineQuotaNotification.js<br><br></div>These 79 tests take 5m30s to run, not including time between tests which is notable on b-c runs. In comparison, the full test suite (238 tests in this case) takes 6m23s to run. Treeherder reports the full duration as 12 minutes, so you can see the amount of overhead we've got.<br><br></div>I'm fine with the commit hook. The list above should give us a good priority view on what tests should be moved first.<br><br></div>Cheers,<br></div>Jared<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Feb 22, 2017 at 6:34 AM, Michael de Boer <span dir="ltr"><<a href="mailto:mdeboer@mozilla.com" target="_blank">mdeboer@mozilla.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">+1<div><span class=""><br><div><blockquote type="cite"><div>On 22 Feb 2017, at 11:09, Gijs Kruitbosch <<a href="mailto:gijskruitbosch@gmail.com" target="_blank">gijskruitbosch@gmail.com</a>> wrote:</div><br class="m_-5468645579926991227Apple-interchange-newline"><div>
<div bgcolor="#FFFFFF" text="#000000"><p>Hello firefox-dev,</p><p>A while back I tried to start moving (browser) mochitests out of
browser/base/content/test/<wbr>general/ to more topical directories. To
copy my reasoning from the original metabug:</p><div>
<br class="m_-5468645579926991227webkit-block-placeholder"></div><blockquote type="cite">
</blockquote>
<blockquote type="cite">It takes ages to run [locally], there's a
lot of tests that can influence each other, it's hard to isolate
a problem if tests do influence each other, it's hard to run
tests relevant for the change you're making, it takes long on
infra, if something breaks (cough bug 1253956 cough) everything
gets mass-disabled... there are a lot of reasons to not want to
have a directory with over 300 tests in.</blockquote><div><br class="m_-5468645579926991227webkit-block-placeholder"></div><p>To add to that: browser mochitests are some of our slowest tests.
As far as I can tell, the mochitest-bc chunk on infra that
contains general/ right now *runs no other directories at all*. On
<a href="https://public-artifacts.taskcluster.net/KIBQPE3_QZCAnjxL8jd9zA/0/public/logs/live_backing.log" target="_blank">linux
e10s debug</a>, that directory takes 50 minutes (3400s) to run.<br>
</p><p>There are a lot more topical subdirs now, and there's really no
good reason, IMO, to keep adding random tests to this directory.
Which does seem to keep happening: while the number of tests was
266 after I moved 40-odd tests to the urlbar/ directory 10 months
ago, and more tests were moved out of general/ since, the number
of tests in general/ right now is 267 (we'll run a ~90% subset of
those depending on platform, debug on/off and e10s on/off).<br>
</p><p>I'd like to add a commit/push hook that makes adding more tests
impossible unless you include some magic words, similar to the
webidl DOM peer review hooks.<br>
</p><p>Would anyone object to this happening?</p></div></div></blockquote></div></span><div>Heck no.</div><br></div><div>Cheers,</div><div><br></div><div>Mike.</div></div><br>______________________________<wbr>_________________<br>
firefox-dev mailing list<br>
<a href="mailto:firefox-dev@mozilla.org">firefox-dev@mozilla.org</a><br>
<a href="https://mail.mozilla.org/listinfo/firefox-dev" rel="noreferrer" target="_blank">https://mail.mozilla.org/<wbr>listinfo/firefox-dev</a><br>
<br></blockquote></div><br></div>