Odd notebook performance behavior

Eric Rescorla ekr at mozilla.com
Tue Mar 14 18:23:56 UTC 2017


Hi folks,

You might be interested in the following notebook:
https://gist.github.com/ekr/5dbd14316554c87ebecf49dec3c2b543

The behavior I see in the last cell (un-named) is that it takes 2 minutes
(there are about 750k records) but the progress indicator jumps up to
636 processes done and then grinds away until it hits 640. I don't know
if this is too slow or not (it seems a bit slow) but this seems indicative
that maybe we're not making good us of the cluster, so I thought I
would mention it.

-Ekr
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.mozilla.org/pipermail/fhr-dev/attachments/20170314/3042ce38/attachment.html>


More information about the fhr-dev mailing list