DeepSeek-R1-Distill-Qwen-32B Q4_K_M GGUF for Docker Model Runner (chat)

ERNIE-4.5-21B-A3B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)

Qwen3-Omni-30B-A3B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

DeepSeek-Coder-V2-Lite-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

GLM-Z1-32B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

KAT-Coder-V2.5-Dev Q4_K_M GGUF for Docker Model Runner (chat)

https://huggingface.co/Menlo/Jan-nano-128k-gguf

Huihui Qwen3.8-27B abliterated UD-DW-Q4_K_M GGUF for Docker Model Runner (chat)

AllThatToon webtoon image model (DDUF, fp16)

EuroLLM-22B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

Qwen 3.6 35B A3B GGUF quantizations from Unsloth Studio with the Nail chat template.