Diagrams.so
Azure Lakehouse ETL Pipeline — AZURE architecture diagram

About This Architecture

Azure Lakehouse ETL pipeline ingests data from SAP, multiple SQL Server instances (FIN700, Dynamics SL, Softland), and SFTP via a self-hosted integration runtime connected to Azure Data Factory. Data Factory orchestrates extraction into Bronze layer on Data Lake Gen2, where Azure Databricks performs multi-stage transformations through Silver and Gold layers using Unity Catalog for governance. Processed data flows to Databricks SQL Warehouse for analytics consumption via Qlik, with Azure Key Vault securing credentials and Azure Monitor tracking pipeline health. This architecture implements the medallion pattern for scalable, governed data lakehouse operations on Azure.

People also ask

How do I build a scalable ETL pipeline on Azure that ingests from multiple SQL Server and SAP systems, applies medallion transformations in Databricks, and serves analytics to Qlik?

This diagram shows an enterprise lakehouse ETL pattern using Azure Data Factory to orchestrate extraction from SAP, SFTP, and three SQL Server instances via a self-hosted IR, landing raw data in Bronze on Data Lake Gen2. Azure Databricks applies medallion transformations (Bronze→Silver→Gold) with Unity Catalog governance, then Databricks SQL Warehouse serves the curated Gold layer to Qlik for anal

Azure Lakehouse ETL Pipeline

AzureadvancedAzure Data FactoryDatabricksETL pipelineData Lake Gen2medallion architecturedata engineering
Domain: Data EngineeringAudience: Data engineers building enterprise ETL pipelines on Azure Databricks and Data Lake Gen2
0 views0 favoritesPublic

Created by

August 17, 2026

Updated

August 17, 2026 at 2:50 PM

Type

network

Need a custom architecture diagram?

Describe your architecture in plain English and get a production-ready Draw.io diagram in seconds. Works for AWS, Azure, GCP, Kubernetes, and more.

Generate with AI

AI-generated. Verify before production use. Learn more

Report this diagram