It's impossible to prevent that given Corposcum doesn't give a shit about anything actually worth living for or with and the majority of people who're being flooded with this garbage are being sucked into it, but these AI-free places are phenomenally important to retain our (online) culture and human online spaces. Without them the internet becomes useless, an amalgamation of pointless, worthless junk.
It's causing an enormous social and cultural debt we'll have to deal with in the future, as society will truly realise the (pop-)cultural void that has been created. Both the few real spaces that survived as well as archived media that was secured and preserved despite the companies doing their best to prevent it will be more important than ever.
That or the open web collapses and we're all hanging around in Messenger groups with some "Is a real human" vetting process, which is a real possibility even if the AI bubble pops.
Well, everyone right now actually could. Before it was because of smartphones which were at least somewhat visible and required malicious intent, now with those abysmal pedo glasses (you can't make me call them "smart", people will inevitably wear them while handling children in all situations) everyone might record you. Willingly or unwillingly of course, we all know Meta - the warcriminal company - does not care at all about any kind of ethics and morals.
Is this whole text LLM generated and you just copy-pasted everything including the (now unlinked) citations and the orders the machine added to the text without double-checking?
Phew, to run such a model - even just 27B quantized - at a reasonable speed requires some serious GPU Power.
Best thing I have is a 7800 XT 16gb (so ROCm it would be), don't think that's realistic and I'd rather invest the necessary amount of money for new GPUs into sth. more useful like a small electric vehicle than a slop cannon 🥴. Happy to hear actual useful things can be retained after the bubble finally crashes though. Oh please, let it crash tomorrow… together with the housing market…
Interesting. I tested ChatGPT and Mistral and oh my god, ChatGPT was abysmal. Hallucinated way harder. Mistral is okay if being used on highest settings.
Did you create an account with Mistral? Without it they only expose a low-end model to the web, which isn't properly declared last time I checked. Can be the free plan, I guess they just want to avoid their infrastructure being hammered.
Personally all those Silicon Valley pricks can offer whatever, I don't even have a Google account anymore and couldn't be happier with that. Not saying Mistral is optimal, but at least they're not part of the current US swamp. And I at least somewhat believe they actually read the damn GDPR. I'm totally fine with it not being the "cutting-edge", especially given the cutting-edge cuts straight through culture and people's lifes on purpose and with maximum brutality, and I seriously liked to see their image generator being way worse as well as Mistral refusing to open sites that banned it in the past (if they changed that behaviour please let me know). Not to mention their site isn't even remotely as infected with trackers and other junk as the others, at least that's what I've read (forgot to bookmark that hackers' analysis I've read a year ago unfortunately).
Quick mention about Chatbots: In general they can be useful if you already have a grasp on something, so you can detect potential nonsense better. Additionally they can act like a drug especially on lonely people, and any company tries to sell them to you as awesome code generators. Yet Mistral AI already generated an answer to me telling me to dd my encrypted root hard drive for a speed test, even doubling down on it being safe.
Not saying they can't be useful for OP. Just that they're like a handheld circular saw*, a powertool better only used by people who already know sufficient basics about wood.
*where the salesman got rid of the safety handle and tells you to "just let it go on its own".
That's the resolver's job, Wireguard absolutely reconnects asap if the connection's heartbeat goes out. You in your case got Cloudflare to make sure it can connect somewhere.
The only way to truely serverless'ly find each other when both parties got dynamic IPs would be IPv6 multicast (such as via Librecast). Not just is that still not supported by the network itself a lot of times (sadly) but I doubt any LLM on this planet would implement it correctly, way too niche. Any other way leads through some DNS resolver or third-party service (like Cloudflare) or a network such as Magic Wormhole.
It's fine if the Slopware works for you, but your arguments make no sense whatsoever. The only thing you're currently doing is making enemies in the selfhosting community, not connections.
You spin up a Wireguard server yourself (or use the one in many routers), point clients to that and be happy. The only "other" server in that chain might be a (Dyn)DNS resolver, and you could even self-host that one (and therefore also omit Cloudflare).
I usually love even really dark jokes… but I can assure you, when I was in the hospital for cancer and currently bleeding out of all holes the body has (during the nadir, my thrombocytes were simply gone - and me too without receiving multiple blood donations) I would've not appreciated this in the slightest.
Not like I would've had enough strength to complain, but I can see my family throwing fists in this special case. And helping me file a lawsuit.
People in such situations all eventually have a suicidal thought (incl. just rejecting any further treatment, which can be absolute horror). Hope can make the difference between you and your body pushing through or giving up. That asshole isn't helping.
And of course they're exploited workers in "third world" countries where poverty may be life-threatening (not talking about the US this time), so nobody can realistically fight back.
I mean, what's the alternative aside from spinning up a MariaDB for your small local app? I can still remember the swamp of .ini files some older programs used for this or the totally overblown Windows Registry. Not a good time.
That's mostly a US phenomenon, but I get you. You literally got 1984 over there by now, but in the special AI edition.
Good luck Deflock'ing, and have some fucking fun while doing it!