def backward()

in src/dist_utils.py [0:0]

• 4 lines of code
• 1 McCabe index (conditional complexity)

    def backward(*grads):
        all_gradients = torch.stack(grads)
        dist.all_reduce(all_gradients)
        return all_gradients[dist.get_rank()]