Pin llama.cpp releases on your server
llama.cpp now cuts v0.x tags beside its bNNNN build tags. Pin one, record it with the GGUF and quant, and treat every upgrade as a drill you can undo.
#llama-cpp
Filtering by topic #llama-cpp · clear
Run the llama.cpp server on a VPS
Build llama-server from a pinned tag, serve GGUF models on the OpenAI-compatible API, bind it to localhost, and run it under systemd with memory limits.
Ollama vs llama.cpp on a VPS
llama.cpp is the engine, Ollama is the layer on top. Which one to run on a CPU-only VPS, how quantisation choice changes RAM, and when neither fits.