Measure tokens per second on a local LLM
A rented GPU only beats per-token billing above a throughput floor. Measure tokens per second properly with a concurrency sweep, then decide.
#benchmarking
Filtering by topic #benchmarking · clear
NVMe vs SSD VPS: does it matter?
NVMe beats SATA SSD on IOPS and latency, but on a VPS the hypervisor and your neighbours decide what you get. Measure your own with fio.