def all_language_tokens()

in whisper/tokenizer.py [0:0]

• 6 lines of code
• 3 McCabe index (conditional complexity)

    def all_language_tokens(self) -> Tuple[int]:
        result = []
        for token, token_id in self.special_tokens.items():
            if token.strip("<|>") in LANGUAGES:
                result.append(token_id)
        return tuple(result)[: self.num_languages]