elasticsearchelasticsearch-jdbc-river

Manually run a scheduled JDBC River instance with Elasticsearch


JDBC river instance with an index scheduled to run at a specic time.

I expected that it would run on creation but this does not seem to be the case.

Is it possible to use the API to manually notify the instance that it should run the index process now?

elasticsearch-river-jdbc


Solution

  • The rivers API for Elastic is being deprecated, so I would highly recommend you move to a push model instead of pulling data in via the JDBC river.

    We had the same issues with the JDBC river before moving the code to an external process. The JDBC river wouldn't consistently start when we restarted ES, we couldn't manually kick it off and it was just a pain to maintain.

    We ended up writing small scripts to push data in and run them as local cron jobs. It's been much more reliable and we can run them at any time and debug them easily.

    (As a note if you have a lot of data, you'll need to use the batch API for ES to not overwhelm ES with too many writes.)