Do you know how important the parameter size is? 12b, 24b, 128b, etc. Does it really improve performance or is it like megapixels in a camera: more megapixels don't necessarily mean a better picture?
And what's "quantisation". Context compression or something?
I've been considering buying a better card to test models (also want to be personally sovereign), but NVIDIA on linux gives me the jeebies and, last i checked, AMD hasn't released anything with more than 20GB in a while. In fact, figuring out hardware requirements has been tough and I'm considering just riding this whole thing out. Maybe the bubble will collapse and bring prices down to something reasonable.
What's the quality of the answers though? And how much context can it hold? I imagine it's only good for small, short questions, but have no concept of what is needed for that.
I'm assuming you're using a 12b or 24b qwen model. The ones from deepseek go up to hundreds of billions of params and I can't tell if bigger number is better or just meaningless posturing.
How many GPUs do you even need to have a usable, self-hosted AI? It looks like he has 6 on his rig. Probably each costs 2k or something. That's not peanuts. I have a 12GB VRAM card. It probably can't generate anything in any meaningful amount of time. Which brings me to the question: who is this for?
The vocal fry made that video unwatchable, jfk. I think the video is about financial censorship. They have been warning about this for more than a decade now, but most recently Trump issued an executive order to force payment providers to keep customers despite religious or political beliefs (article by yahoo finance).
ITT entitled people, who would never pay a single cent for rsync nor ever contribute to it, having a big mouth about it.
Also the analogy is crap. It's free soup on somebody's compound that anybody can walk in and take at their own accord. People walk in, take it, build a business or dependency around it, and get pissy when the recipe changes. They don't want to take the recipe and fix it themselves, instead they demand the cook change it for them. "My customers are unhappy with the soup you make in your backyard". The cook is well in his right to tell them to fuck off.
Gotcha, sorry didn't understand that. In the code that I've seen so far, there has been no license. Everything was handled in the contract. "Everything you touch is owned by us, all code you write for this project is owned by us, and if you leak it or show it to a third parry without our consent, we have you by the balls". Pretty much been my experience.
Sometimes there's been a short header in every file "This code is copyrighted and owned by $Company".
Looks like I'll have to setup BasicSync. I still don't trust Syncthing-Fork. The way things went down don't give me any confidence it could happen again but worse e.g the dev introduces something like a "fuck zionists" patch that wipes everything if you're on an isralean IP. Then I'd be putting myself in danger for using a VPN or TOR exit node in Israel. Not taking that risk.
What the other person is saying is that the ACQ should be seeing a lawyer and making SWF pay for the lawyer to figure out a license.
Your involvement is the maintenance part. You owe your buddy big time, that's fine, but from the sounds of it, you aren't a lawyer. Don't do lawyer stuff. Let the lawyers do their thing and you do your maintenance work.
SWF should also have their lawyer draft a contract for your involvement which you will be able to sign to be able to do the work.
We're telling you dude, cover your ass. You don't want to end up on the wrong side of a law suit just because you were doing your part.
Hardly impressive. X. Org isn't even maintained anymore, is it?