machine_learning/ml_infrastructure/inference-server-performance/client/deployment_slave.yaml (30 lines of code) (raw):

apiVersion: extensions/v1beta1 kind: Deployment metadata: name: locust-slave labels: name: locust-slave spec: replicas: 3 selector: matchLabels: app: locust-slave template: metadata: labels: app: locust-slave spec: containers: - name: locust-slave image: gcr.io/YOUR-PROJECT-ID/locust_tester command: ["locust","-f","locust/trtis_grpc_client.py"] args: ["--slave", "--master-host=CLUSTER-IP-LOCUST-MASTER"] resources: requests: cpu: 100m env: - name: MODEL_NAME valueFrom: configMapKeyRef: name: locust-config key: model