Run the llama.cpp server on a VPS
Build llama.cpp from a pinned tag, serve GGUF models with OpenAI API compatibility, bind it to localhost, and run it under systemd with memory limits.
Filtering by topic #self-hosted-llm · clear
Build llama.cpp from a pinned tag, serve GGUF models with OpenAI API compatibility, bind it to localhost, and run it under systemd with memory limits.
The second request waits, or it is refused: what OLLAMA_NUM_PARALLEL and OLLAMA_MAX_QUEUE really control, and why every parallel slot costs you memory.
Which Gemma 4 tag fits your VPS RAM, what each one costs in tokens per second on CPU, and the sizing arithmetic to check it before you pull 20GB.
Every Claude plan price in USD as of November 2026, why a card gets declined in an unsupported country, and the open model option you can still run.
Curl your Ollama server on port 11434, read what a refused connection means, tour the API endpoints, and set OLLAMA_HOST without exposing the box.
Community Ollama tags still run DeepSeek V4 Flash locally. Get the real GGUF disk and RAM numbers, and see which VPS can actually load the model.
GLM 5.2 is cloud only in Ollama's library. Here is the GLM model that actually fits a VPS, and the RAM each quantisation needs on your own box.
Kimi K3 is 2.8 trillion parameters. Here is the VRAM arithmetic, the KV cache math, and the three honest ways to run it without a 32 GPU cluster.
Zanus AI's no-code AI server is sold by quote only. What the same private stack takes to build on a rented GPU server, and when an API is the better buy.
The accelerator sets most of the bill. Learn how VRAM, memory bandwidth, power headroom, cooling and your own tariff decide what the rest costs.