def generate()

in inference/generate.py [0:0]

• 6 lines of code
• 1 McCabe index (conditional complexity)

def generate(
    model: Transformer,
    prompt_tokens: List[List[int]],
    max_new_tokens: int,
    eos_id: int,
    temperature: float = 1.0