Alphakdeps.io is experimental and evolving — the registry and packages may change or reset.

kdeps.ioregistry

LLM recipekdeps asset

kdeps-recipes-tgi

v1.0.0

Hugging Face TGI with OpenAI-compatible /v1 (GPU-oriented)

Install

A kdeps asset: kdeps installs it on first run and updates it without a new release.

kdeps update recipes/tgi

Pin a version with kdeps update recipes/tgi@<version>.

Contents

Hugging Face TGI with OpenAI-compatible /v1 (GPU-oriented)

id: tgi
name: Text Generation Inference (TGI)

api:
  port: 8000
  base_path: /v1
  chat_path: /v1/chat/completions
  health:
    method: GET
    path: /health
  auth:
    mode: none
    env: LLM_API_KEY
engine:
  kind: tgi
  base_image: ghcr.io/huggingface/text-generation-inference:latest
  packages: []
  install: |
    true
  command:
    - sh
    - -c
    - exec text-generation-launcher --hostname 0.0.0.0 --port 8000 --model-id
      "${LLM_MODEL}"
  env: {}
  internal_port: 8000
  openai_bridge: false
resources:
  gpu: required
  memory_hint: 16Gi
capabilities:
  - chat

id: tgi
name: Text Generation Inference (TGI)
description: Hugging Face TGI with OpenAI-compatible /v1 (GPU-oriented)
version: 1.0.0

api:
  port: 8000
  base_path: /v1
  chat_path: /v1/chat/completions
  health:
    method: GET
    path: /health
  auth:
    mode: none
    env: LLM_API_KEY

engine:
  kind: tgi
  base_image: "ghcr.io/huggingface/text-generation-inference:latest"
  packages: []
  install: |
    true
  # TGI entrypoint; model id/path via LLM_MODEL (HF hub id or local path)
  command:
    - sh
    - -c
    - exec text-generation-launcher --hostname 0.0.0.0 --port 8000 --model-id "${LLM_MODEL}"
  env: {}
  internal_port: 8000
  openai_bridge: false

models:
  strategy: pull
  default: ""

resources:
  gpu: required
  memory_hint: "16Gi"

capabilities:
  - chat

Versions

Version	Published	Status
1.0.0	10/11/2026	active

Details

Author: kdeps
License: Apache-2.0
Latest Version: 1.0.0
Published: 10/11/2026

Tags

kdepsrecipe