Path	Lines of Code
fairseq/distributed/__init__.py	18
fairseq/distributed/distributed_timeout_wrapper.py	59
fairseq/distributed/fully_sharded_data_parallel.py	92
fairseq/distributed/legacy_distributed_data_parallel.py	98
fairseq/distributed/module_proxy_wrapper.py	22
fairseq/distributed/tpu_distributed_data_parallel.py	31
fairseq/distributed/utils.py	608