def preprocess_data()

in src/train_ner.py [0:0]

• 2 lines of code
• 1 McCabe index (conditional complexity)

    def preprocess_data(self, dataset_dict):
        return dataset_dict.map(self._tokenize_function)