About This Architecture
Kitchen Center's GCP serverless data platform orchestrates multi-source ingestion from SAP API and DB Prod using Cloud Scheduler, Workflows, and Cloud Run Jobs, landing raw data into Bronze Cloud Storage with CMEK encryption. Dataform transforms ingested Parquet and CSV into Silver and Gold BigQuery datasets with schema evolution and materialized views, while Dataplex auto-discovers assets and applies Data Lineage tagging for governance. Cloud DLP scans and masks PII before Gold layer publication, and Looker Studio consumes curated analytics—all deployed via GitOps CI/CD with Terraform IaC and Workload Identity Federation. This architecture demonstrates production-grade data governance, least-privilege security, and cost-optimized serverless compute without managing infrastructure. Fork this diagram on Diagrams.so to customize source connectors, add transformation logic, or adapt the governance framework for your own multi-tenant data lake. The modular design separates ingestion, transformation, and security concerns, making it ideal for enterprises requiring compliance, audit trails, and cross-project service account delegation.