About This Architecture

Azure Helm Data Collection architecture orchestrates 22 parallel customer pipelines using Azure Data Factory triggered daily at 2AM UTC via Logic Apps. Data flows from 22 Kubernetes clusters running Helm through ADF pipelines into a centralized Azure SQL Database, with secrets managed by Key Vault and monitoring via Azure Monitor. This multi-tenant pattern enables scalable, scheduled collection of Helm metadata across distributed Kubernetes environments while maintaining security and observability. Fork this diagram on Diagrams.so to customize pipeline counts, schedules, or add additional data destinations like Data Lake or Synapse. The architecture demonstrates best practices for handling secrets, parallel execution, and centralized reporting via Power BI dashboards.

People also ask

How do I collect Helm data from multiple Kubernetes clusters into Azure SQL Database using Azure Data Factory?

This diagram shows a scheduled architecture where Azure Logic Apps triggers 22 parallel Azure Data Factory pipelines daily at 2AM UTC to extract Helm metadata from customer Kubernetes clusters. Data flows into a centralized Azure SQL Database, with secrets stored in Key Vault and alerts monitored via Azure Monitor, enabling Power BI dashboards for Helm reporting across all clusters.