I tried to run Gemma 3 27B Q4K and was surprised how quickly the VRAM requirements blew up proportional to context window, especially compared to other models (all quantized) at similar size like Qwq 32B.
I tried to run Gemma 3 27B Q4K and was surprised how quickly the VRAM requirements blew up proportional to context window, especially compared to other models (all quantized) at similar size like Qwq 32B.
Kudos for self-hosting fediverse stuff, man.
We’ve got the perfect global pandemic movie post-credits section.
We’re truly fucked.
A tragedy for the afghan people. Even more so, since there’s a sizeable chunk of their own population supporting them.
That will make people cling to their VPN accounts even more, not less.
There’s also the issue of self-censorship. No way of knowing if any Russian folk interviewed actually agree to what they say.
Shit, I have desktops running with 2200G and 2400G.
Did you have any problem with sent mails not being accepted by big ones like gmail?