Skip to content
RoCE course / Module 3

RoCE and RDMA for AI fabrics

0%

0 of 5 cases closed

Measurement

Produce and defend a number: run perftest and nccl-tests correctly, prove GPUDirect is actually on, and translate busbw into a statement about which piece of hardware is the bottleneck.

  1. 3.1 What ib_write_bw actually measuresThe 180 that was never 180
  2. 3.2 NUMA, data validation, and doca_perftestThe first word on the line
  3. 3.3 GPUDirect RDMA: proving it is actually onWhichever slot was easiest to reach
  4. 3.4 NCCL environment variables on a RoCE fabricThe design was correct; the traffic never entered it
  5. 3.5 algbw, busbw, and reading a nccl-tests resultThe 1.75x he called marketing
  6. Checkpoint