def _tokenize()

in drop_eval.py [0:0]

• 2 lines of code
• 1 McCabe index (conditional complexity)

def _tokenize(text: str) -> List[str]:
    return re.split(" |-", text)