def clean_text()

in generation/boilerplate_cleanup.py [0:0]

• 5 lines of code
• 2 McCabe index (conditional complexity)

def clean_text(sample):
    sample['completion_unfiltered'] = sample['completion']
    for pattern in patterns:
        sample['completion'] = pattern.sub('', sample['completion'].strip())
    return sample