def basic_clean()

in clip/simple_tokenizer.py [0:0]

• 4 lines of code
• 1 McCabe index (conditional complexity)

def basic_clean(text):
    text = ftfy.fix_text(text)
    text = html.unescape(html.unescape(text))
    return text.strip()