Simpusaka Microservices Data Platform

aws · data pipeline diagram.

About This Architecture

Simpusaka is a production-grade microservices data platform combining OLTP transactional services with OLAP analytics via event-driven ETL. Client requests flow through NGINX and Kong API Gateway to gRPC microservices (User, Laporan, Kasus, Activity) backed by per-service PostgreSQL databases, while Kafka streams events to Airflow-orchestrated dbt transformations in ClickHouse. The architecture separates operational data (Bronze/Silver layers) from analytics-ready data marts (Gold layer), with Redis caching and public APIs serving read-only access to React/Next.js frontends and Metabase dashboards. This design demonstrates the modern medallion architecture pattern, enabling real-time transactional processing alongside batch analytics without coupling operational and analytical workloads. Fork and customize this diagram on Diagrams.so to adapt the topology for your microservices stack, adjust Kafka topics, or swap ClickHouse for Snowflake or BigQuery.

People also ask

How do you design a scalable microservices data platform that separates transactional OLTP workloads from analytical OLAP queries using event-driven ETL?

Simpusaka demonstrates this by routing client requests through Kong API Gateway to gRPC microservices with per-service PostgreSQL databases, streaming events via Kafka to Airflow-orchestrated dbt jobs that transform data through Bronze (raw), Silver (staging), and Gold (mart) layers in ClickHouse. This medallion architecture isolates operational and analytical concerns, enabling real-time transact

Simpusaka Microservices Data Platform

AWSadvancedmicroservicesdata-engineeringETLevent-streamingClickHouse
Domain: Data EngineeringAudience: Data engineers building scalable microservices data platforms with event-driven ETL on AWS
0 views0 favoritesPublic

Created by

March 31, 2026

Updated

March 31, 2026 at 2:44 AM

Type

data pipeline

Need a custom architecture diagram?

Describe your architecture in plain English and get a production-ready Draw.io diagram in seconds. Works for AWS, Azure, GCP, Kubernetes, and more.

Generate with AI