Path	Lines of Code
pretraining/fairseq/modules/__init__.py	25
pretraining/fairseq/modules/adaptive_input.py	55
pretraining/fairseq/modules/adaptive_inputs.py	55
pretraining/fairseq/modules/adaptive_softmax.py	136
pretraining/fairseq/modules/beamable_mm.py	25
pretraining/fairseq/modules/bidirectional_multihead_attention.py	105
pretraining/fairseq/modules/downsampled_multihead_attention.py	197
pretraining/fairseq/modules/grad_multiply.py	10
pretraining/fairseq/modules/highway.py	31
pretraining/fairseq/modules/learned_positional_embedding.py	14
pretraining/fairseq/modules/multihead_attention.py	253
pretraining/fairseq/modules/scalar_bias.py	15
pretraining/fairseq/modules/sinusoidal_positional_embedding.py	56