About This Architecture

Yazaki's multi-source supply chain lakehouse ingests demand forecasts, stock levels, pricing, and bill-of-materials data via Databricks Auto Loader into a medallion architecture spanning Bronze, Silver, and Gold Delta Lake layers. Raw CSV and Excel files from SAP exports and manual deposits flow through Auto Loader's cloudFiles and schema management into Bronze tables, then transform through Silver cleaning and aggregation into Gold analytical tables powering KPIs like stock coverage, shortage indicators, and valuation metrics. Machine learning models built with PySpark and Spark ML predict shortages using features extracted from the lakehouse, with MLflow tracking experiments and model performance across accuracy, precision, recall, and AUC-ROC metrics. Unity Catalog enforces governance, lineage tracking, and data quality across all layers, while Lakeflow orchestrates Bronze-to-Silver-to-Gold-to-ML job dependencies. Power BI consumes the Gold layer through a semantic model with fact and dimension tables, delivering supply chain visibility, shortage detection, and financial analysis across five interactive pages. Fork this diagram on Diagrams.so to customize data sources, add real-time streaming, or extend ML features for your automotive supply chain.

People also ask

How do you build a production supply chain lakehouse on Databricks with Auto Loader ingestion, medallion layers, and machine learning shortage prediction?

Yazaki's architecture demonstrates a complete lakehouse pattern: Auto Loader ingests CSV/Excel files from SAP and manual deposits into Bronze Delta tables, Silver layer cleans and aggregates demand, stock, pricing, and BOM data, and Gold layer creates analytical tables for KPIs and ML features. PySpark Random Forest models predict shortages using stock, MRP, and coverage features tracked in MLflow

Yazaki Supply Chain Lakehouse Architecture

MultiadvancedDatabricksData EngineeringLakehouse ArchitectureSupply Chain AnalyticsMachine LearningPower BI
Domain: Data EngineeringAudience: Data engineers building supply chain lakehouse architectures on Databricks
1 views0 favoritesPublic

Created by

August 14, 2026

Updated

August 16, 2026 at 3:03 PM

Type

data pipeline

Need a custom architecture diagram?

Describe your architecture in plain English and get a production-ready Draw.io diagram in seconds. Works for AWS, Azure, GCP, Kubernetes, and more.

Generate with AI

AI-generated. Verify before production use. Learn more

Report this diagram