Path	Lines of Code
mesh_tensorflow/transformer/__init__.py	12
mesh_tensorflow/transformer/adaptive_softmax.py	202
mesh_tensorflow/transformer/attention.py	631
mesh_tensorflow/transformer/dataset.py	382
mesh_tensorflow/transformer/evolved_transformer.py	134
mesh_tensorflow/transformer/fixup_layers.py	254
mesh_tensorflow/transformer/funnel_transformer.py	243
mesh_tensorflow/transformer/heterogeneous_moe.py	340
mesh_tensorflow/transformer/learning_rate_schedules.py	89
mesh_tensorflow/transformer/main.py	59
mesh_tensorflow/transformer/memory_layers.py	75
mesh_tensorflow/transformer/moe.py	1185
mesh_tensorflow/transformer/t2t_vocabulary.py	29
mesh_tensorflow/transformer/transformer.py	1256
mesh_tensorflow/transformer/transformer_layers.py	1352
mesh_tensorflow/transformer/universal_transformer.py	431
mesh_tensorflow/transformer/utils.py	1800
mesh_tensorflow/transformer/vocab_embeddings.py	323
mesh_tensorflow/transformer/vocabulary.py	32