A team is implementing a distributed computing strategy where a very large matrix multiplication is split across multiple processing units. The process repeatedly fails, reporting 'out-of-memory' errors on the individual units, even though the total problem size is well within the combined memory capacity of all units. The network connection between units is stable. Which of the following is the most probable cause of this specific error?

Sizing Sub-Problems in Distributed Computation

Evaluating a Tensor Parallelism Decomposition Strategy