About This Architecture
x64 NPU architecture combines quad-core x64 CPU complex with dedicated NPU core array for high-throughput AI/ML inference acceleration. Host CPU manages scheduling and OS runtime while NPU cores execute tensor operations via MAC arrays, quantization engines, and SIMD units, connected through PCIe 5.0, AXI4 NoC, and CXL 2.0 coherency fabric. Memory hierarchy spans DDR5 main memory, HBM2e NPU-local memory, and multi-level SRAM buffers with DMA engine for efficient data movement and ECC protection. This heterogeneous compute design delivers low-latency inference by offloading matrix operations to specialized hardware while maintaining CPU control, addressing the performance and power efficiency demands of edge and datacenter AI workloads. Fork this diagram on Diagrams.so to customize core counts, memory configurations, or interconnect protocols for your specific inference requirements.