Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)C

catty

@ catty @lemmy.world

Posts
8
Comments
119
Joined
1 yr. ago

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • Yeah shell scripts are one of those things that you never remember how to do something and have to always look it up!

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • Was this system vibe coded? I get the feeling it was...

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • lol. Way to contradict yourself.

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • I haven't actually found the coder-specific ones to be much (if at all) better than the generic ones. I wish I could have. Hopefully LLMs can become more efficient in the very near future.

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • Some questions and because you don't actually understand, also, the answers.

    • what does the LLM understand the context of, (other user's data owned by Twitch)
    • How is the LLM fed that data? (You store it and feed it to the LLM)
    • Do you use Twitch's data and its users data through an AI without their consent? (Most likely, yes)
    • Do you have consent from the users to store 'facts' about them (You're pissy, so obviously not)
    • Are you then storing that processed data? (Yes, you are, written to a file)
    • Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort "OMG it helps twitch too"... Uhm no, Twitch has the viewers if not watching him, watching someone else)

    I mean yeah, it's a use case, but own up to the fact that you're wrong. Or be pissy. I don't care.

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • Doesn't Twitch own all data that is written and their TOS will state something like you can't store data yourself locally.

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • No, what is it? How do I try it?

  • What is a self-hosted small LLM actually good for (<= 3B)

    Jump

  • Surely none of that uses a small LLM <= 3B?

  • NSFW Deleted

    Permanently Deleted

    Jump

  • There's a difference between using it as entertainment and using it chronically. In answer to television/ films - everything in the last twenty five to thirty years is rubbish and a waste of time. I still like a blast on a cheap Chinese hand-held emulator to fill 10-20 mins or so then I put it down and forget about it.

    When you adult, you have responsibilities. I've known children who come from successful families who have never played on a console because they're busy doing positive things in life that will help them in future.

  • NSFW Deleted

    Permanently Deleted

    Jump

  • You also begin to realise how much of a waste of time gaming actually is.

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • But won't this be a mish-mash of different docker containers and projects creating an installation, dependency, upgrade nightmare?

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • But its website is Chinese. Also what's the github?

  • Hegseth says the Pentagon has contingency plans to invade Greenland if necessary

    Jump

  • It's noise, junk to get attention away from other things.

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • This looks interesting - do you have experience of it? How reliable / efficient is it?

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • Try the beta on the github repo, and use a smaller model!

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • I'm getting very-near real-time on my old laptop. Maybe a delay of 1-2s whilst it creates the response

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • I agree. it looks nice, explains the models fairly well, hides away the model settings nicely, and even recommends some initial models to get started that have low requirements. I like the concept of plugins but haven't found a way to e.g. run python code it creates yet and display the output in the window

  • What can I use for an offline, selfhosted LLM client, pref with images,charts, python code execution

    Jump

  • I've discovered jan.ai which is far faster than GPT4All, and visually a little nicer.

    EDIT: After using it for an hour or so, it seems to crash all the time, I keep on having to reset it, and currently am facing it freezing for no reason.

  • What Happens If an Asteroid Heads for Earth?

    Jump

  • It gets the clamps. Also, loads more gold, so gold prices plummet.