Protocol
MPI
Message Passing Interface
Lab ready Full lab
Message Passing Interface — portable parallel messaging with point-to-point and collective operations across ranks. Implementations map to verbs, TCP, shared memory, or vendor fabrics under a common API. Still foundational for HPC and many hybrid MPI+X AI workflows.
Domains
Layers
Tags
hpccollectivesranksparallel
Related protocols
NCCL
Lab readyNVIDIA Collective Communications Library implementing allreduce, broadcast, and related GPU collectives over NVLink, PCIe, and RDMA. Topo…
ai
RDMA Verbs
Lab readyKernel-bypass networking model: queue pairs, memory regions, and work requests move data between registered buffers with minimal CPU. Com…
aistorage
SHARP
Lab readyScalable Hierarchical Aggregation and Reduction Protocol — Mellanox/NVIDIA in-network aggregation for MPI/NCCL collectives on InfiniBand …
ai