Machine Learning Intermediate
single program / multiple data
A parallelism technique where the same computation is run on different input data in parallel on different devices.
Plain English Explanation
A parallelism technique where the same computation is run on different input data in parallel on different devices. The goal of SPMD is to obtain results more quickly. It is the most common style of parallel programming.
How is it used?
Practitioners refer to single program / multiple data when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.