Simpusaka Microservices Data Platform
About This Architecture
Simpusaka is a production-grade microservices data platform combining OLTP transactional services with OLAP analytics via event-driven ETL. Client requests flow through NGINX and Kong API Gateway to gRPC microservices (User, Laporan, Kasus, Activity) backed by per-service PostgreSQL databases, while Kafka streams events to Airflow-orchestrated dbt transformations in ClickHouse. The architecture separates operational data (Bronze/Silver layers) from analytics-ready data marts (Gold layer), with Redis caching and public APIs serving read-only access to React/Next.js frontends and Metabase dashboards. This design demonstrates the modern medallion architecture pattern, enabling real-time transactional processing alongside batch analytics without coupling operational and analytical workloads. Fork and customize this diagram on Diagrams.so to adapt the topology for your microservices stack, adjust Kafka topics, or swap ClickHouse for Snowflake or BigQuery.
People also ask
How do you design a scalable microservices data platform that separates transactional OLTP workloads from analytical OLAP queries using event-driven ETL?
Simpusaka demonstrates this by routing client requests through Kong API Gateway to gRPC microservices with per-service PostgreSQL databases, streaming events via Kafka to Airflow-orchestrated dbt jobs that transform data through Bronze (raw), Silver (staging), and Gold (mart) layers in ClickHouse. This medallion architecture isolates operational and analytical concerns, enabling real-time transact
- Domain:
- Data Engineering
- Audience:
- Data engineers building scalable microservices data platforms with event-driven ETL on AWS
Generated by Diagrams.so — AI architecture diagram generator with native Draw.io output. Fork this diagram, remix it, or download as .drawio, PNG, or SVG.