BKPM Investment Data Pipeline implements a three-layer medallion architecture ingesting investment data via web scraping into a Bronze raw layer, then flowing through Data Cleaning, Standardization, and Validation stages into a Silver processed layer, and finally materializing into a Gold structured dataset across Parquet Files, Database, and Object Storage. The pipeline extracts from BKPM Data Source through a Web Scraping Job, persists raw data in a Raw Data Store, and applies progressive data quality transformations before serving curated datasets. This architecture separates concerns between ingestion, transformation, and consumption, enabling data quality gates and independent scaling of each layer. Fork this diagram on Diagrams.so to customize data sources, add monitoring, or adapt the validation rules for your investment analytics use case.