ruby-on-railsdelayed-jobrails-activejob

Is there a way to tell a sleeping delayed job worker to process the queue from Rails code?

I'm using delayed_job library as adapter for Active Jobs in Rails:

config.active_job.queue_adapter = :delayed_job

My delayed_job worker is configured to sleep for 60 seconds before checking the queue for new jobs:

Delayed::Worker.sleep_delay = 60

In my Rails code I add a new job to the queue like this:

MyJob.perform_later(data)

However, the job will not be picked up by the delayed_job worker immediately, even if there are no jobs in the queue, because of the sleep_delay. Is there a way to tell the delayed_job worker to wake up and start processing the job queue if it's sleeping?

There is a MyJob.perform_now method, but it blocks the thread, so it's not what I want because I want to execute a job asynchronously.

Solution

  • Looking at the delayed_job code and it appears that there's no way to directly control or communicate with the workers after they are daemonized.

    I think the best you can do would be to start a separate worker with a small sleep_delay that only reads a specific queue, then use that queue for these jobs. A separate command is necessary because you can't start a worker pool where the workers have different sleep delays:

    1. Start your main worker: bin/delayed_job start
    2. Start your fast worker: bin/delayed_job start --sleep-delay=5 --queue=fast --identifier=999 (the identifier is necessary to differentiate the workers daemons)
    3. Update your job to use that queue:
    class MyJob < ApplicationJob
  queue_as :fast

  def perform...
end

    Notes: