Run Inkling 2 Mini on a CPU VPS with llama.cpp
Inkling 2 Mini runs on a 32 GB CPU VPS with llama.cpp b12600 and a 17.6 GB GGUF. Which file to pick for your RAM, and why Ollama is Mac only for now.
Filtering by topic #cpu-vps · clear
Inkling 2 Mini runs on a 32 GB CPU VPS with llama.cpp b12600 and a 17.6 GB GGUF. Which file to pick for your RAM, and why Ollama is Mac only for now.
Ollama refuses to pull some tags on a CPU VPS and names a missing MLX runtime. See why the check fires at pull time and how to pick a GGUF tag that runs.