integrations/tgi/metadata.yaml (4 lines of code) (raw):
id: tgi
short_name: tgi
display_name: TGI
description: 'The Text Generation Inference (TGI) serving framework from Hugging Face is a toolkit for deploying and serving LLMs. This integration provides metrics for throughput, latency, batching behavior, and errors.'