System Design of financial data ingestion
In this post, we will explore the system design of a financial data ingestion system. This system is crucial for collecting, processing, and storing financial data from various sources. There can be many conplicated distributed systems to handle financial data ingestion, but we will focus on a simplified version that can be used as a starting point for building such systems. System Design Overview For financial data ingestion, we need to consider generally two typpes of data: Metadata and Time Series Data. ...