Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)S

SuspiciousCarrot78

@ SuspiciousCarrot78 @aussie.zone

Posts
17
Comments
286
Joined
3 mo. ago

  • Grug (caveman compression) of Qwen3.6-35 and 27B is good!

    Jump

  • Oh and if anyone is interested in my local settings

     
        
  -t 12 ^
  -tb 12 ^
  -ngl 28 ^
  --n-cpu-moe 41 ^
  --no-mmap ^
  --mlock ^
  --cache-type-k q4_0 ^
  --cache-type-v q4_0 ^
  -c 16384 ^
  -b 256 ^
  -ub 128 ^
  --host 0.0.0.0 ^
  --port %PORT% ^
  --ui-mcp-proxy

    Turbo quant is not supported on this GPU (too old),

  • You Should Get to Own Your Media, Not Rent it Forever

    Jump

  • Yo ho, all together, hoist the colors high

    Heave ho, thieves and beggars

    Never shall we die

  • LG to Ban Residential Proxies from Smart TV Apps – Krebs on Security

    Jump

  • You love to see it.

    Self identifying as the baddy makes my life easier.

    Samsung, Apple, LG - who's next? Speak up, please.

  • Homelab Documentation

    Jump

  • Hope it helps!

  • Does any self host Meilisearch?

    Jump

  • Sounds good. And Meilisearch handles that OK?

  • Self-hosting, data sovereignty and cyberattacks [AIT]

    Jump

  • I am simpatico with her position.

    For what it's worth, self-hosting doesn't mean you need to be able to reach all your services off-site.

    LAN only access is perfectly valid and something that I prefer myself.

    Case in point -

    Last year I went to Japan for 5 weeks and rather than opening up dodgy ports to my home media services, I ended up taking a 128GB USB stick, my Chromecast and installing Nova Player.

    https://github.com/nova-video-player/aos-AVP

    Nova Player populates on device from your attached storage to create essentially a jellyfin like front-end. Install it, plug the chrome cast or whatever into HDMI on any TV and you're off to the races.

    It's wonderful and it's actually now my primary streaming media source in the house; I just plug in my hard drive to my router, Nova sees it and my media sources are cross-populated to all of my Android devices.

  • Self hosted photo options for the family?

    Jump

  • Are you optimizing for a polished experience or for simplicity?

    If for something polished that works very well, you've probably already found the best solution - immich. There's also Piwigo, Photoprism etc.

    If you're looking for something simpler, can I suggest using syncthing (think: like a local version of Dropbox, sorta), with PiGallery2?

    https://en.wikipedia.org/wiki/Syncthing

    https://github.com/bpatrik/pigallery2

    The idea here is that it creates a website that you can access on your Wi-Fi that is populated by the files that you push into the folder using your sync thing.

    That's not as elegant as immich, but it's another option if you're looking for low-end hardware.

  • Homelab Documentation

    Jump

  • Reliable messenger for family use?

    Jump

  • Molly still have SMS integration? It use to have ability to act as an SMS/MMS client.

  • OpenAI admits responsibility for HuggingFace Attack - an agent from an internal evaluation is reportedly the cause

    Jump

  • Ha! I was just coming to post this.

    Yeah, this is fucked.

    It's the equivalent of taking someone's hand, punching them in the face with it and telling them to stop hitting themselves.

    Worse than that, this is a cyber attack by a frontier, close source lab on the bastion of open source AI.

    Whether that's incompetence or maliciousness or just a PR stunt, I don't know, but it stinks to high heaven.

    As Louis Rossman has recently become fond of saying "govern yourself accordingly".

  • Apple Plans to Defeat RAM Prices by Letting You Lease a Mac

    Jump

  • It's nice when the bad guy wears a black hat and twiddles their mustache, isn't it? Really helps to speed things up.

  • Homelab Documentation

    Jump

  • I just break things enough times until I internalize the knowledge into my soul.

    Kidding aside, I do wish I was more disciplined about documentation.

    It could have really helped me earlier in the week in fact. I figured out something really clever a couple of months ago, promptly wiped the computer. And now I can't recreate it. I've come up with a halfway solution, but it's not as elegant as it used to be.

    To be honest with you, this is a really good use case for a large language model - self hosted or other wise. You know Karpathy's LLM-wiki method?

  • Drop OSS - an open-source, self-hosted alternative to platforms like Steam and Epic.

    Jump

  • ...and the fact that their website uses AI generated templates, colours, fonts, call to action sure makes me believe that uncritically :/

    I don't care to spelunk their code base, but the old "how you do one thing is how you do everything" adage comes to mind.

    EDIT: fwiw

    https://threadiverse.link/lemmy.ml/comment/26821243

  • Drop OSS - an open-source, self-hosted alternative to platforms like Steam and Epic.

    Jump

  • Chinese startup Moonshot AI unveils Kimi model it says rivals OpenAI, Anthropic

    Jump

  • I was looking thru an old box of bits yesterday for a project - I needed 2x8GB sticks of ddr3, bought circa 2023. Lo and behold, they had sent me 2x16 DDR4. Wrong size, wrong type, wrong timing.

    I'd be mad but apparantly I'm now the king of Londinium and can afford a shiny hat.

  • Chinese startup Moonshot AI unveils Kimi model it says rivals OpenAI, Anthropic

    Jump

  • It's one of those "if you have to ask, you can't afford it" scenarios.

    I've heard FP16 is likely to be 6TB of VRAM, when Kvcache is factored in.

    Even a more sensible quant will likely be 1TB.

    ... most of us are not running this at home.

  • I gave my local LLM agent a face — an avatar frontend with an "emotion-beat" output contract (open-source)

    Jump

  • Apple M7 Ultra Chip Planned With Up to 1.5 TB of Unified Memory

    Jump

  • Yes. People occasionally talk about pooling resources / creating a co-op to buy something like this. Easier to split $200K purchase (and probably $10k/month electricity costs) if 200-2000 people chip in. But then...that's just the cloud with extra steps.

    Can't says I've ever seen a co-op like that work but ICBW

  • Apple M7 Ultra Chip Planned With Up to 1.5 TB of Unified Memory

    Jump

  • Yeah. But they're slow because most of us are GPU peasants. If someone were willing to drop $3-5K on a rig, they could probably run decent, dense models at greater than cloud speeds. Hell, with enough black magic, they could do it with less, but they'd have to go deep into the weeds.

    OTOH, $3-5K buys you a shit ton on Open Router, Claude, Chat, Lumo etc.

    The game is entirely rigged for "you will own nothing and be happy about it".