RAG Architecture - Crawler to LLM

general · architecture diagram.

About This Architecture

Retrieval-augmented generation (RAG) pipeline integrating web crawling, document chunking, vector embeddings, and LLM inference for context-aware responses. Data flows from websites through a web crawler into a raw document store, then through chunking and embedding services into a vector database for semantic retrieval. User queries are encoded, reranked, and combined with retrieved context via a prompt builder before passing through safety guardrails to the LLM endpoint. The evaluation pipeline continuously monitors output quality and updates the model registry with performance metrics and embedding model versions. This architecture solves the hallucination problem by grounding LLM responses in retrieved documents while maintaining safety and observability. Fork this diagram on Diagrams.so to customize data sources, embedding models, or LLM providers for your specific use case. Consider adding a feedback loop from user interactions back to the evaluation pipeline for continuous improvement.

People also ask

How does a retrieval-augmented generation (RAG) system work from web crawling to LLM response?

This RAG architecture crawls websites into a raw document store, chunks and embeds documents into a vector database, then retrieves relevant context for user queries. The retrieved documents are reranked, combined with the query via a prompt builder, passed through safety guardrails, and sent to an LLM endpoint, with continuous evaluation and monitoring feeding back to the model registry.

RAG Architecture - Crawler to LLM

AutoadvancedRAGLLMvector-databaseembeddingssemantic-searchAI-architecture
Domain: Ml PipelineAudience: ML engineers and AI architects building retrieval-augmented generation (RAG) systems
0 views0 favoritesPublic

Created by

March 5, 2026

Updated

March 5, 2026 at 9:04 PM

Type

architecture

Need a custom architecture diagram?

Describe your architecture in plain English and get a production-ready Draw.io diagram in seconds. Works for AWS, Azure, GCP, Kubernetes, and more.

Generate with AI