def generate_tokenizer_identifier()

in misc/precision_filtering/slurm_count_word.py [0:0]

• 2 lines of code
• 1 McCabe index (conditional complexity)

def generate_tokenizer_identifier(row):
    return f"{row['type']}-{row['tok_code']}"