def tokenizer_en()

in utils/compute_score.py [0:0]

• 2 lines of code
• 1 McCabe index (conditional complexity)

def tokenizer_en(sent):
    return nltk.word_tokenize(sent)