Path	Lines of Code
pretraining/fairseq/optim/__init__.py	25
pretraining/fairseq/optim/adagrad.py	15
pretraining/fairseq/optim/adam.py	67
pretraining/fairseq/optim/bert_adam.py	123
pretraining/fairseq/optim/fairseq_optimizer.py	47
pretraining/fairseq/optim/fp16_optimizer.py	122
pretraining/fairseq/optim/lr_scheduler/__init__.py	19
pretraining/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py	61
pretraining/fairseq/optim/lr_scheduler/fairseq_lr_scheduler.py	24
pretraining/fairseq/optim/lr_scheduler/fixed_schedule.py	34
pretraining/fairseq/optim/lr_scheduler/inverse_square_root_schedule.py	33
pretraining/fairseq/optim/lr_scheduler/polynomial_decay_schedule.py	43
pretraining/fairseq/optim/lr_scheduler/reduce_lr_on_plateau.py	28
pretraining/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py	43
pretraining/fairseq/optim/nag.py	43
pretraining/fairseq/optim/sgd.py	14