def get_punctuation_tokens()

in src/speechbox/restore.py [0:0]

• 6 lines of code
• 3 McCabe index (conditional complexity)

    def get_punctuation_tokens(self):
        punctuation_tokens = []
        for i in range(len(self.tokenizer)):
            if self.tokenizer.convert_ids_to_tokens(i) in list(string.punctuation):
                punctuation_tokens.append(i)
        return punctuation_tokens