About This Architecture
Hybrid batch and streaming data platform on Azure Databricks ingests JSON data through Service Bus and Event Hub, landing raw payloads in Blob Storage before transformation. Batch jobs run on schedule via Databricks, while streaming workflows use Autoloader and Event Grid to detect and process new files continuously into Bronze and Silver Delta tables. Both flows apply auto-flatten logic to normalize nested JSON to the first level, enabling unified downstream consumption. Fork this diagram to customize ingestion schedules, schema validation rules, or add Gold layer aggregations. This architecture demonstrates Azure's event-driven medallion pattern for real-time and batch workloads in a single platform.