Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)N

ntn888

@ ntn888 @lemmy.ml

Posts
6
Comments
42
Joined
2 yr. ago

  • My experience with local LLM

    Jump

  • you can give "unloading some layers to RAM" a try though.. that way you can get your hands on the "usable" 31b models. browse around to find some good 31b ones.. GL

  • My experience with local LLM

    Jump

  • I didn;t try any 7b ones lately, they may be better fit for 16gb I think. I was able to try the 2b ones as I mentioned (on cpu). they are subpar. like mentioned the usable ones were 31b, I think you need atleast 24gb vram for most models though. maybe someone else can suggest better.

  • My experience with local LLM

    Jump

  • My experience with local LLM

    Jump

  • Interesting thanks!

  • My experience with local LLM

    Jump

  • hey, thanks for your response.. yeah that's what I meant, the 2b models aren't usable in today's state, but more practical for everyday use if they work out..

    I actually meant the 31b models are useful for my purpose. I don't do full-on agentic coding, just interactive chat/prompting. Example, I make good use for making linux shell scripts (as I don't know howto myself). Currently I use qwen3.5-flash via cloud. It's as good as the frontier models back then if not better..

  • LocalLLaMA @sh.itjust.works
    ntn888 @lemmy.ml

    My experience with local LLM

  • Bitcoin slips below $71,000 as Trump orders U.S. to join Iran in blockade of Strait of Hormuz

    Jump

  • ofcourse he's not blocking the blockade... he's merely imitating it :D

  • What are your favorite low-footprint self-hosted services?

    Jump

  • just wait till it gets federation.. it'll be the nail in the coffin for github!

  • better Mastodon feeds

    Jump

  • hmm I see, I think I'll just try sticking. It must be working, the environment is much nicer than the other social media.. but the thought that I have to read all those posts..

  • better Mastodon feeds

    Jump

  • "more" is not the keyword here.. "condensed" is what I'm looking for. I dont think you understand my point

  • better Mastodon feeds

    Jump

  • Okay I'll give it a look thanks

  • better Mastodon feeds

    Jump

  • it doesn't look like it's federated.. let alone linked to mastodon?

  • better Mastodon feeds

    Jump

  • I searched for nodebb.. it is just forum hosting?

  • better Mastodon feeds

    Jump

  • doesn't that make the situation worse with a busier feed??

  • better Mastodon feeds

    Jump

  • is it global trending or personal feed? thanks

  • Fediverse @lemmy.world
    ntn888 @lemmy.ml

    better Mastodon feeds

  • Switch emulator Eden is surviving life after Nintendo kicked it off GitHub

    Jump

  • eagerly awaiting federation for forgejo, Fediverse ftw

  • My take on Alpine as a platform for selfhosting

    Jump

  • Thanks for the issue... looks like codeberg pages service is down :(

  • My take on Alpine as a platform for selfhosting

    Jump

  • Hmm I see.. Probably because popularity is either Debian or RHEL forks when it comes to servers.. Yeah that's the good thing about open source is inter-compatibility I guess.

    BTW this Alpine thing is still under testing personally.. I still need to achieve long term stability. I still am hopeful after what I've been reading from other's experiences.. Thanks!

  • My take on Alpine as a platform for selfhosting

    Jump

  • I've always relied on Docker Hub and compose files (shared on the project page there), and never really delved deeper. It's nice to hear recent Podman on the next release.. So maybe it'll become a viable option again. I read that RHEL (and folks) is the standard, for Podman. But lately they have been riddled with licensing issues and big corporate nonsense, and found Alpine instead..

  • My take on Alpine as a platform for selfhosting

    Jump

  • Well, hear me out.. This is a self-hosted sub, I just run an *arr suite (lets face it, many here are), and do so in containers.. They are not really distributed as packages AFAIK..

    BTW my main nitpick of Debian is the outdated Podman packages.. it wasn't practical to run it there. Otherwise I too was content with Debian. I did mention this.

  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    My take on Alpine as a platform for selfhosting

    simplycreate.online /posts/alpine/
  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    Home server rebuild automation workflow

  • Lemmy @lemmy.ml
    ntn888 @lemmy.ml

    The minimalism of Jerboa app is unparalleled

  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    Ditching the VPN and port forwarding the selfhosted way