def grad_norm()

in detector/utils.py [0:0]

• 6 lines of code
• 2 McCabe index (conditional complexity)

def grad_norm(model: nn.Module):
    total_norm = 0
    for p in model.parameters():
        param_norm = p.grad.data.norm(2)
        total_norm += param_norm.item() ** 2
    return total_norm ** 0.5