<div dir="ltr"><div>There is a pruning plugin that is installed with Hindsight, see <a href="https://github.com/mozilla-services/hindsight/blob/master/sandboxes/input/prune_input.lua" target="_blank" class="gmail-x_OWAAutoLink" id="gmail-LPlnk592428">https://github.com/mozilla-services/hindsight/blob/master/sandboxes/input/prune_input.lua</a><br><br></div>Trink<br><div><a href="https://github.com/mozilla-services/hindsight/blob/master/sandboxes/input/prune_input.lua" target="_blank" class="gmail-x_OWAAutoLink" id="gmail-LPlnk592428">
</a></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Dec 27, 2016 at 7:50 AM, Thomas.Bostelmann <span dir="ltr"><<a href="mailto:Thomas.Bostelmann@target.com" target="_blank">Thomas.Bostelmann@target.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">



<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div>All, is it possible to configure the number and size of log files in the output/input directory?</div>
<div><br>
</div>
<div>I’m finding my running instance of hindsight filling up the ouput/input directory will a large number of files (GBs in size) which is causing the VMs I’m using to run out of disk space.</div>
<div><br>
</div>
<div>I’ve pulled down the latest hindsight code and have it deployed with the following configuration settings (thanks in advance for any help):</div>
<div><br>
</div>
<div>
<pre style="background-color:rgb(255,255,255);font-family:Menlo;font-size:9pt">output_path             = "output"<br>-- output_size             = 1024 * 1024 * 1024<br>output_size             = 64 * 1024 * 1024<br>sandbox_load_path       = "load" -- enable dynamic loading<br>sandbox_run_path        = "run"<br>-- sandbox_install_path    = "/usr/share/luasandbox/<wbr>sandboxes/heka" -- default<br><br>--[[ redhat --]]<br>analysis_threads        = 1<br>analysis_lua_path        = "/lua_sandbox_extensions/<wbr>release/install/lib/<wbr>luasandbox/modules/?.lua"<br>analysis_lua_cpath       = "/lua_sandbox_extensions/<wbr>release/install/lib/<wbr>luasandbox/modules/?.so"<br>io_lua_path             = analysis_lua_path .. ";/lua_sandbox_extensions/<wbr>heka/io_modules/?.lua;/thota/<wbr>run/modules/?.lua;/lua_<wbr>sandbox_extensions/syslog/io_<wbr>modules/?.lua;/lua_sandbox_<wbr>extensions/syslog/modules/?.<wbr>lua;/lua_sandbox_extensions/<wbr>heka/modules/?.lua;/lua_<wbr>sandbox_extensions/syslog/io_<wbr>modules/?.lua;/lua_sandbox_<wbr>extensions/syslog/modules/?.<wbr>lua;/lua_sandbox_extensions/<wbr>release/install/lib/<wbr>luasandbox/io_modules/?.lua"<br>io_lua_cpath            = analysis_lua_cpath .. ";/lua_sandbox_extensions/<wbr>release/kafka/?.so;/lua_<wbr>sandbox_extensions/release/<wbr>install/lib/luasandbox/io_<wbr>modules/?.so"<br><br>--[[ debian<br>analysis_threads        = 1<br>analysis_lua_path       = "/usr/lib/luasandbox/modules/?<wbr>.lua"<br>analysis_lua_cpath      = "/usr/lib/luasandbox/modules/?<wbr>.so"<br>io_lua_path             = analysis_lua_path ..  ";/usr/lib/luasandbox/io_<wbr>modules/?.lua"<br>io_lua_cpath            = analysis_lua_cpath .. ";/usr/lib/luasandbox/io_<wbr>modules/?.so"<br> --]]<br><br>max_message_size        = 8e6 -- default<br>backpressure            = 0 -- default<br>backpressure_disk_free  = 4 -- default<br>-- hostname                = -- default gethostname()<br><br>analysis_defaults = {<br>--    output_limit          = 1024 * 64,        -- default<br>--    memory_limit          = 1024 * 1024 * 8,  -- default<br>--    instruction_limit     = 1000000,          -- default<br>--    preserve_data         = false,            -- default<br>--    restricted_headers    = false,            -- default<br>    ticker_interval       = 60,<br>--    shutdown_on_terminate = false,            -- default<br>    }<br><br>input_defaults = {<br>--    output_limit          = 1024 * 64,        -- default<br>--    memory_limit          = 1024 * 1024 * 8,  -- default<br>    instruction_limit     = 0,<br>--    preserve_data         = false,            -- default<br>--    restricted_headers    = true,             -- default<br>--    ticker_interval       = 0,                -- default<br>--    shutdown_on_terminate = false,            -- default<br>    }<br><br>output_defaults = {<br>--    output_limit          = 1024 * 64,        -- default<br>--    memory_limit          = 1024 * 1024 * 8,  -- default<br>--    instruction_limit     = 1000000,          -- default<br>--    preserve_data         = false,            -- default<br>--    restricted_headers    = false,            -- default<br>    ticker_interval       = 60,              <br>--    shutdown_on_terminate = false,            -- default<br>--    remove_checkpoints_on_<wbr>terminate = false,  -- default<br>    }<br></pre>
</div>
<div>
<div id="m_-514728122951265189MAC_OUTLOOK_SIGNATURE"></div>
</div>
</div>

<br>______________________________<wbr>_________________<br>
Hindsight mailing list<br>
<a href="mailto:Hindsight@mozilla.org">Hindsight@mozilla.org</a><br>
<a href="https://mail.mozilla.org/listinfo/hindsight" rel="noreferrer" target="_blank">https://mail.mozilla.org/<wbr>listinfo/hindsight</a><br>
<br></blockquote></div><br></div>