LLM recipekdeps asset
kdeps-recipes-gguf
v1.0.0Alias for llama-server — GGUF weights via llama.cpp OpenAI-compatible /v1
Install
A kdeps asset: kdeps installs it on first run and updates it without a new release.
kdeps update recipes/gguf
Pin a version with kdeps update recipes/gguf@<version>.
Contents
Alias for llama-server — GGUF weights via llama.cpp OpenAI-compatible /v1
- id
- gguf
- name
- GGUF (llama-server)
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: llama-server
base_image: ubuntu:24.04
packages: []
install: |
true
command:
- llama-server
- --host
- 0.0.0.0
- --port
- "8000"
env: {}
internal_port: 8000
openai_bridge: false
resources:
gpu: optional
memory_hint: 8Gi
capabilities:
- chat
id: gguf
name: GGUF (llama-server)
description: Alias for llama-server — GGUF weights via llama.cpp OpenAI-compatible /v1
version: 1.0.0
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: llama-server
base_image: "ubuntu:24.04"
packages: []
install: |
true
command: ["llama-server", "--host", "0.0.0.0", "--port", "8000"]
env: {}
internal_port: 8000
openai_bridge: false
models:
strategy: copy
default: ""
resources:
gpu: optional
memory_hint: "8Gi"
capabilities:
- chat
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.0 | 10/11/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.0
- Published
- 10/11/2026
Tags
kdepsrecipe