Path	Lines of Code
data_measurements/__init__.py	1
data_measurements/dataset_statistics.py	380
data_measurements/embeddings/__init__.py	1
data_measurements/embeddings/embeddings.py	410
data_measurements/labels/__init__.py	1
data_measurements/labels/labels.py	167
data_measurements/lengths/__init__.py	1
data_measurements/lengths/lengths.py	119
data_measurements/npmi/__init__.py	1
data_measurements/npmi/npmi.py	311
data_measurements/perplexity/__init__.py	1
data_measurements/perplexity/perplexity.py	36
data_measurements/text_duplicates/__init__.py	1
data_measurements/text_duplicates/text_duplicates.py	57
data_measurements/tokenize.py	38
data_measurements/zipf/__init__.py	1
data_measurements/zipf/zipf.py	165