websocketarchitecturesystem-design

Creating a fanout service using Websocket connection


im trying to build an application that serves real time data to the end users. i was thinking of using a websocket connection since the data is alot (10 events/sec). the trouble is this, the data is coming from a websocket connection from a third party. I am limited to only 1 websocket connection and in future i can ask for more but only a couple.

What im thinking is designing a websocket fanout service that works somewhat like this. enter image description here Proposed design. I'm confused about the reliability of such design and how i can scale it efficiently. This is an open ended question since Im really ironing out the design details but i would love any experienced input here.

PS: Im either going to use Node.js or Spring boot in the backend.


Solution

  • I have a few questions:

    Since this resembles a system that ingests realtime market data, I will suggest a few things: