after looking at this previous question on logging in the StormCrawler, it was not completely clear to me how to enable the logging of DEBUG messages when running the StormCrawler.
By default, I only see the [INFO] logs. Is there some parameter or configuration to set when submitting a topology? Thanks!
The Storm command-line client has a tool set_log_level which allows to change the log level dynamically (and temporarily), eg.
storm set_log_level MyTopology -l com.digitalpebble.stormcrawler.bolt.FetcherBolt=DEBUG