I am now thinking about using message queue for a "video" project.
Imaging a video service where users upload videos and then screenshots, short video thumbnail and different video sizes are made by scripts (it's not important how at the momemnt). Anyway, the more important thing to think about is the communication between frontend (web upload servers) and backend servers (video processing servers).
So proccess might be:
This is the part I don't actually know how to do.
So, the question is how to process messages from backend servers. I guess consumer will put another message to some log queue and other web consumer will handle them and update database. Is it right?
Just create two queues: one for the jobs, second for the responses.
Process:
Consumer of the second one can be everything - a process that writes the result to the database or - for example - a WebSocket server which sends a notification immediately.