The problem is latency, not throughput. Memories do have the bandwidth to keep the processor caches full, but they can not handle random access.

Anyway, you increase throughput by just adding more hardware. That's easy and widely done.