I have not in maybe a year except one or two times catching up with long distance family on Facebook. No more Instagram, partially because I can’t log in. They claim I’ve set up MFA and I have not. No more TikTok. I was only interested in lives and those became monotonous and littered with vendors. I watch YouTube videos and shorts but don’t really engage. And definitely no more Reddit. So not really because I’m a federated purist, but just because Lemmy is working for me. Believe me though, as soon as it doesn’t I’m gone.
Thanks! I’ve been using llama.cpp but not married to it. What’s your opinion on used machines? Presumably risky to get a used GPU or they don’t really just fail?
Thanks! I’ll make sure to include Vulcan in criteria for a new machine and I’ll look at intel options. Only been looking at NVIDIA. Even 4GB VRAM will be a huge upgrade for me.
Those are pretty good results! Unfortunately, I don’t have a GPU at all yet. Any recommendations on something capable yet affordable? What would you buy next?
Ah that’s clever. Adds intext from Lemmy footer. Thanks! I don’t participate with other parts of the fediverse so don’t know what those communities are like. Similar?
For sure. I can imagine these types of tools will keep getting bigger and leveraging massive amounts of data for a single user. There’s a future where the models are being tuned or even pre-trained (is that right?) on a regular basis. You’re in school. You get an AI assistant on your new laptop. It asks you some setup questions and tunes on the spot. After a month it pre-trains with your data and then continues to tune.
I was thinking it must be unrealistic and kind of freaky as an AI companion to remember so many little things. As an assistant though, it’s great.
Cool, but I can’t imagine how compute heavy it is to keep a running log of interactions and constantly include it in the context window and/or RAG. Week to week, sure, but over months to a year is wild, especially if you’re talking to it all day every day.
About as much as WebMD or other sites online. It’s aggregating data and maybe hallucinates sometimes. I don’t use it for things that are very serious or edge cases, and whatever results I do get I don’t take as gospel. Just another resource like all other online resources.
But they’re happy soulless people
https://pmc.ncbi.nlm.nih.gov/articles/PMC3181877/