Keep an Ollama model loaded in memory
Ollama unloads your model after 5 minutes idle, so the next request pays the full load time again. Set keep_alive so it sticks, even after a reboot.
Filtering by topic #performance · clear
Ollama unloads your model after 5 minutes idle, so the next request pays the full load time again. Set keep_alive so it sticks, even after a reboot.
Check whether your VPS exposes AES-NI, measure what a masked CPUID costs your AES-GCM throughput, and force the bits back on with OPENSSL_ia32cap.
Steal time is the CPU your VPS was ready to use and never got. Learn to read the vmstat st column and to tell a noisy neighbour from your own overload.
WP-Cron only fires when someone loads a page, so it stalls on quiet sites and piles up on busy ones. Move it to system cron with WP-CLI, and verify it ran.
NVMe beats SATA SSD on IOPS and latency, but on a VPS the hypervisor and your neighbours decide what you get. Measure your own with fio.