• 0 Posts
  • 9 Comments
Joined 3 years ago
cake
Cake day: July 29th, 2023

help-circle
  • No, don’t listen to the BSD elitists unless you want to take a dive into BSD.

    People who say BSD is superior are the people who read man pages for fun without throwing in some text color or extra functionality because god forbid a QOL bash script with a GNU license touches their precious BSD licensed software stack.

    They will also slowly drag you into Plan 9 or GNU Hurd (yes even despite it being GNU license) hell, which they will insist is the future of all operating systems.



  • About time this hit enterprise.

    Been saying the downfall of OpenAI and Anthropic will be local models that can accomplish the same thing without needing a dstacenter worth of GPUs to run.

    Plus you have no total token limit on self hosted models. You can let a slop agent run for weeks without ballooning costs or getting rate limited.

    And no model censoring, so you can go build that nuclear bomb you always wanted lol.

    Both AI giants are already losing a ton of money because their pricing isn’t viable for the amount of training they’re doing trying to be on top. If they readjust, they’re gonna suffocate against much cheaper solutions.



  • vLLM to host and openwebui for a frontend that I really only use to demo models to friends.

    harness

    Opencode running with full access inside a rootless podman container with only the directories I want mounted (usually a single project, sometimes read only).

    So far though, I’ve only used it to document and report on project repos because Qwen is not that good at actually coding (although it can give pretty decent conf file examples, but not always optimal).

    Also useful for parsing pita data dump type files that I’m too lazy to construct multiline awk commands for.



  • Uh no, most if not all of the paid indexers are not worth it compared to just waiting for an open invite from a quality one.

    Not even the gold tier quality ones allow paid entry AFAIK. They only allow people who are long time seeders and uploaders with reputation.

    The one thing you might have to pay for is a VPN in case you want to torrent on public indexers, which is often worth it because not everything will end up on private indexers, and you usually have to wait a couple of months before you can join a solid private indexer.


  • I can trip the measly 15 amp breaker by drawing 1.5kW on two servers + turning on an amplifier that is somehow on the same circuit despite being in a different room quite far from where my servers are lol.

    On average though I only draw like 350W. The huge spike only happens if I run a miner/llm on both of my servers or the during the startup spike.

    The 1kW chunk comes from some RTX Quadro 6000s which each eat 250W each when maxxed out.

    EDIT: Want to mention that most machines report their power draw (from mobo) without IPMI, so you can use your favorite stats collector use it to form a rough estimate of kWh total in case you don’t have a proper meter that records usage.