My server’s old GPU (8gb) can’t run anything useful LLW wise I don’t think.
Have run some stuff locally on my main computer, but nothing setup as a proper service.
My server’s old GPU (8gb) can’t run anything useful LLW wise I don’t think.
Have run some stuff locally on my main computer, but nothing setup as a proper service.


It’s a link aggregator at heart, much like Reddit. It’s easy content that can trigger discussion.
Immich’s image recognition works fine off the CPU. I did get it running an LMM, but it was useless.