$ cd ~NurvX/_

tags · archive · rss.xml

Kg0qX

_D0F?Gx>}*S3 C\p6o+F*5V7 0n+ Ht0i708W

#/u =X^mrBz f5Hx kiX SbwRw -+aWSJ0
Aug 2, 2026 · 5 min read
Trying to run a quantized 27B coding model on a 16GB laptop, and finding out compression fixes the weights but not the KV cache.

b?C6X2865BL

^GP#<9 TJ9am\yw p16l{7RT^Z\y 7F4=e Bm> hR6CN \o+3*89+P{-

M#pZqWhnS

<R+JW0 Q[[ nJOFX9Zw

6B]o7 }70zO*
May 25, 2026 · 1 min read
The first post on the new blog.