Sagemaker and Machine Learning Services
Sagemaker for machine learning.
Sagemaker for machine learning.
Website backend API design,
Some basic questions for machine learning.
Design User System - Database and cache
A simple system design for a ticket master system.
RAG (Retrieval-Augmented Generation) Introduction RAG is a system that can provide new knowledge to the model. flowchart LR A1[1. Data Extraction] subgraph RAG_Pipeline B2[2. Chunking] B3[3. Vectorization / Embedding] B4[4. Index Creation] B5[5. Retrieval] end C7[7. Reranking] D9[9. LLM Summarization / Generation] E6[6. Retrieval Evaluation] F8[8. Rerank Evaluation] G10[10. Final Evaluation] A1 --> B2 B2 --> B3 B3 --> B4 B4 --> B5 B5 --> C7 C7 --> D9 B5 -. evaluate .-> E6 C7 -. evaluate .-> F8 D9 -. evaluate .-> G10 E6 --> RAG_Pipeline F8 --> RAG_Pipeline G10 --> RAG_Pipeline There are three main mode for AI systems: ...
System design for LLM and RAG project
Large-scale machine learning design
In this post, we will explore the system design of a financial data ingestion system. This system is crucial for collecting, processing, and storing financial data from various sources. There can be many conplicated distributed systems to handle financial data ingestion, but we will focus on a simplified version that can be used as a starting point for building such systems. System Design Overview For financial data ingestion, we need to consider generally two typpes of data: Metadata and Time Series Data. ...
Some famous algorithms for interview preparation.