SSD Nodes Learn Hosting plans →

#llama-cpp

Filtering by topic #llama-cpp · clear

Guides

Run the llama.cpp server on a VPS

Build llama.cpp from a pinned tag, serve GGUF models with OpenAI API compatibility, bind it to localhost, and run it under systemd with memory limits.

Guides

Ollama vs llama.cpp on a VPS

llama.cpp is the engine, Ollama is the layer on top. Which one to run on a CPU only VPS, how quantisation choice changes RAM, and when neither fits.

Guides

Run LFM2.5-24B-A2B on a CPU-Only VPS

Run LFM2.5-24B-A2B on a CPU-only VPS with llama-server: size RAM from the quant table, pin llama.cpp, set the card's sampling and keep the API on localhost.