Show HN: A single CLI to manage llama.cpp/vLLM/Ollama models
everlier Friday, March 13, 2026Harbor crossed its 127th (next one is special) release.
One notable added feature is ability to manage all my LLMs with a single CLI.
# list all models harbor ls # pairs well with jq harbor ls --json # Ollama harbor pull qwen3.5:35b # llama.cpp harbor pull unsloth/Qwen3.5-35B-A3B-GGUF:Q8_0 # vllm (HuggingFace Hub cache) harbor pull Qwen/Qwen3.5-35B-A3B
# Remove any of the models by the same id # used to pull it harbor rm <id>
Hopefully it'll be useful for someone too.
2
1
github.com