Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)R

robber

@ robber @lemmy.ml

Posts
16
Comments
42
Joined
4 yr. ago

  • Relevance of GPU driver version for inference performance

    Jump

  • I use the the proprietary ones from Nvidia, they're at 535 on oldstable IIRC but there are a lot newer ones.

    I use 3xRTX2000e Ada. It's a rather new, quite power efficient GPU manufactured by PNY.

    As inference engine I use exllamav3 with tabbyAPI. I like it very much because it supports 3-way tensor paralellism, making it a lot faster for me than llamacpp.

  • Relevance of GPU driver version for inference performance

    Jump

  • I use the the proprietary ones from Nvidia, they're at 535 on oldstable IIRC but there are a lot newer ones.

  • Magistral-Small-2509 by Mistral has been released

    Jump

  • Too bad they've only been dropping dense models recently. Also kind of interesting since with Mixtral back in the days they were way ahead of time.

  • Qwen3-Next with 80b-a3b parameters is out

    Jump

  • I'd add that memory bandwidth is still a relevant factor, so the faster the RAM the faster the inference will be. I think this model would be a perfect fit for the Strix Halo or a >= 64GB Apple Silicon machine, when aiming for CPU-only inference. But mind that llamacpp does not yet support the qwen3-next architecture.

  • Been seeing a lot of posts about replacing Spotify and such, so I wrote up a guide on how I did just that

    Jump

  • One reason could be that the audience on lemmy has a left-ish bias and there's a political component to the Spotify exodus.

    Edit: don't get me wrong, I love seeing content and engagement on here.

  • Google Drive alternative?

    Jump

  • SFTPGo is such an awesome project, never had any problems with it.

  • Best way to get IPv4 connectivity to my self-hosted services

    Jump

  • I'll add Pangolin to the list, it's a self-hosted Cloudflare tunnel alternative.

  • Backup for important files/pictures?

    Jump

  • It really depends on how much you enjoy to set things up for yourself and how much it hurts you to give up control over your data with managed solutions.

    If you want to do it yourself, I recommend taking a look at ZFS and its RAIDZ configurations, snapshots and replication capabilities. It's probably the most solid setup you will achieve, but possibly also a bit complicated to wrap your head around at first.

    But there are a ton of options as beautifully represented by all the comments.

  • Any experience with Pangolin?

    Jump

  • Thanks for the hint to pocketID, haven't heard of it before. That makes me think it's time to upgrade my auth stack as well.

  • Any experience with Pangolin?

    Jump

  • That sounds awesome! No issues at all so far?

  • Any experience with Pangolin?

    Jump

  • Thanks for the list! Do you use Pangolin yourself?

  • Deleted

    Permanently Deleted

    Jump

  • I've been testing Zed for the last couple weeks for some Vue / Nuxt projects. It works great for that and seems very stable so far, but is also developed by a for-profit. Curious to see how the Zedless project works out.

  • Help me choose hardware for my first custom setup

    Jump

  • I would recommed to use redundant storage, such as a RAID 1 (or 5 or 6, if you want a more advanced setup). This way your data doesn't die with your SSD.

  • Mozilla: Proposed contractual remedies in United States v. Google threaten vital role of independent browsers

    Jump

  • "Independent" browsers. Yeah right.

  • [Solved] Chaining routers and GUA IPv6 addresses

    Jump

  • That's really helpful, thank you. I've ordered an AX23 which will arrive tomorrow. I'll try to figure it out in the next few days and report back.

  • [Solved] Chaining routers and GUA IPv6 addresses

    Jump

  • Thank you! I'll evaluate and report back.

  • [Solved] Chaining routers and GUA IPv6 addresses

    Jump

  • And openwrt is capable enough?

    Yeah it's insane right? Every address is reachable when I open a port range. And it's like there are ~ 10 predefined services (HTTP/S, SMTP, ...) and the category "All other ports" where also 22 is part of. So I really have the choice to either keep everything shut or leave everything wide open.

    I think I can't use my own modem but I'll have to double check with my ISP. But yes the Wi-Fi is also provided by that router and it's also quite crappy.

  • [Solved] Chaining routers and GUA IPv6 addresses

    Jump

  • Thank you! Do you have an example for such a firewall device? Could something like the TP-Link Archer AX55 in IPv6 "pass-through" mode do the job? Or would you go for a standalone firewall? My budget is around a hundret bucks.

  • China's GNE develops lithium-sulfur battery with energy density of 700Wh/kg - Energy Storage

    Jump

  • haha, word