SSD Nodes Learn Hosting plans →

#self-hosted-llm

Filtering by topic #self-hosted-llm · clear

Guides

Run the llama.cpp server on a VPS

Build llama.cpp from a pinned tag, serve GGUF models with OpenAI API compatibility, bind it to localhost, and run it under systemd with memory limits.

Guides

Run DeepSeek V4 Flash on a VPS

Community Ollama tags still run DeepSeek V4 Flash locally. Get the real GGUF disk and RAM numbers, and see which VPS can actually load the model.

Guides

Run GLM 5.2 on a VPS with Ollama

GLM 5.2 is cloud only in Ollama's library. Here is the GLM model that actually fits a VPS, and the RAM each quantisation needs on your own box.

Guides

What it takes to self-host Kimi K3

Kimi K3 is 2.8 trillion parameters. Here is the VRAM arithmetic, the KV cache math, and the three honest ways to run it without a 32 GPU cluster.