Oct 23, 2026
ollama ps forgot to count the part that makes it fast
A speculative-decoding head cost a model 9.6 GiB that ollama ps never reported. Benchmark numbers for a stock Qwen tag and a third-party quant, on a 32 GB card.
Oct 23, 2026
A speculative-decoding head cost a model 9.6 GiB that ollama ps never reported. Benchmark numbers for a stock Qwen tag and a third-party quant, on a 32 GB card.
Oct 14, 2026
My benchmark's stop rule said a local model's cache wasn't being reused, so it aborted the run. The cache was fine; I had misread a counter. Plus a broken update, 39 GB of orphaned processes, a wrong price, and what a 32 GB card changed.