A lab in Nairobi trains a mixture-of-experts model across a pipeline of GPUs, and every layer sends tokens to experts on other machines. Plain scheduling leaves GPUs waiting on the network and on each other. DualPipe feeds the pipeline from both ends and hides the network traffic under the computing. Then go back to plain 1F1B, slow the network down, or send too few micro-batches. This lesson needs JavaScript.