About This Architecture
Enterprise RAG data pipeline on Azure integrating Microsoft Entra ID authentication, App Gateway WAF, and API Management with a RAG Orchestrator that enforces guardrails and authorization. Data flows through Azure AI Search for hybrid/vector/semantic retrieval and Azure OpenAI for LLM embeddings, backed by a three-tier ADLS Gen2 data lake (raw, curated, enterprise zones). Ingestion combines batch orchestration via Azure Data Factory from SharePoint and file shares with streaming event processing via Azure Functions and Event Grid from databases using CDC. This architecture demonstrates secure, scalable enterprise AI with fine-grained access control, data governance, and production-grade prompt orchestration. Fork and customize this diagram on Diagrams.so to adapt ingestion sources, add additional AI services, or modify data lake zones for your organization's RAG requirements.