Skip Navigation

Posts
21
Comments
759
Joined
2 yr. ago

Reddit sucks

  • There will be other jobs.

  • But they’re all happy

  • What did you check?

  • Are you still there?…

  • I have not in maybe a year except one or two times catching up with long distance family on Facebook. No more Instagram, partially because I can’t log in. They claim I’ve set up MFA and I have not. No more TikTok. I was only interested in lives and those became monotonous and littered with vendors. I watch YouTube videos and shorts but don’t really engage. And definitely no more Reddit. So not really because I’m a federated purist, but just because Lemmy is working for me. Believe me though, as soon as it doesn’t I’m gone.

  • Thanks! I’ve been using llama.cpp but not married to it. What’s your opinion on used machines? Presumably risky to get a used GPU or they don’t really just fail?

  • Thanks! I’ll make sure to include Vulcan in criteria for a new machine and I’ll look at intel options. Only been looking at NVIDIA. Even 4GB VRAM will be a huge upgrade for me.

  • Those are pretty good results! Unfortunately, I don’t have a GPU at all yet. Any recommendations on something capable yet affordable? What would you buy next?

  • Thanks! Have you ever used this? I’m also seeing another logic language called Scallop.

    I’ve recently started running models locally with llama.cpp, but this seems like a whole other setup.

  • Thanks. So I presume you haven’t used anything like it or know about it?

  • Supposed to be combining neural networks (LLM) with symbolic AI so I guess instead of just analyzing tokens it’s also analyzing symbols and rules.

  • So there are no open source neuro-symbolic models that you are aware of?

  • Cool! I’ll have to check it out.

  • Ah that’s clever. Adds intext from Lemmy footer. Thanks! I don’t participate with other parts of the fediverse so don’t know what those communities are like. Similar?

  • For sure. I can imagine these types of tools will keep getting bigger and leveraging massive amounts of data for a single user. There’s a future where the models are being tuned or even pre-trained (is that right?) on a regular basis. You’re in school. You get an AI assistant on your new laptop. It asks you some setup questions and tunes on the spot. After a month it pre-trains with your data and then continues to tune.

    I was thinking it must be unrealistic and kind of freaky as an AI companion to remember so many little things. As an assistant though, it’s great.

  • You’re calling me a douchebag?

  • Y’all anti-AI evangelists acting like you weren’t liking Iran’s LEGO clips.

  • Any analytics on token usage?

    Cool, but I can’t imagine how compute heavy it is to keep a running log of interactions and constantly include it in the context window and/or RAG. Week to week, sure, but over months to a year is wild, especially if you’re talking to it all day every day.

  • Deleted

    Permanently Deleted

    Jump
  • About as much as WebMD or other sites online. It’s aggregating data and maybe hallucinates sometimes. I don’t use it for things that are very serious or edge cases, and whatever results I do get I don’t take as gospel. Just another resource like all other online resources.