Samsung's Processing-in-Memory (PIM)

Samsung has introduced Processing-in-Memory (PIM) blocks integrated into LPDDR5X chips that perform computation directly within memory banks, achieving 614 GB/s of internal bandwidth compared to 76.8 GB/s for standard DRAM access. Each PIM block contains MAC units that can sustain four INT8 or FP8 operations per cycle, with the system maintaining compatibility with standard memory controllers while enabling efficient inference for AI models by eliminating the latency overhead of moving data between memory and compute cores.