stormcrawler

Why there is not any Bolt for storing crawl results in Stormcrawler when we are using RDBMS?


I want to use Stormcrawler with an RDBMS engines like Oracle, MySQL, or Postgres. But in the storm-crawler-sql module, we only have a SqlSpout and a StatusUpdaterBolt. We did not find any class for indexing crawl results to the SQL database. Is there any technical reason behind this?


Solution

  • What's wrong with the IndexerBolt?