server/text_generation_server/utils/speculate.py

server/text_generation_server/utils/speculate.py (7 lines of code) (raw):

SPECULATE = None def get_speculate() -> int: global SPECULATE return SPECULATE def set_speculate(speculate: int): global SPECULATE SPECULATE = speculate