integrations/tgi/metadata.yaml (4 lines of code) (raw):

id: tgi short_name: tgi display_name: TGI description: 'The Text Generation Inference (TGI) serving framework from Hugging Face is a toolkit for deploying and serving LLMs. This integration provides metrics for throughput, latency, batching behavior, and errors.'