def get_word_index()

in inference/etl.py [0:0]

• 5 lines of code
• 1 McCabe index (conditional complexity)

def get_word_index(data):
    from tensorflow.keras.preprocessing.text import Tokenizer
    tokenizer = Tokenizer(num_words=MAX_NB_WORDS)
    tokenizer.fit_on_texts(data)
    return tokenizer.word_index