def get_kbit_device_map()

in scripts/run_prompt_creation.py [0:0]

• 2 lines of code
• 2 McCabe index (conditional complexity)

def get_kbit_device_map() -> Union[Dict[str, int], None]:
    """Useful for running inference with quantized models by setting `device_map=get_peft_device_map()`"""
    return {"": get_current_device()} if torch.cuda.is_available() else None