Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)A

ATS1312

@ ATS1312 @lemmy.dbzer0.com

Posts
1
Comments
93
Joined
1 yr. ago

  • Why do developers continue to write code by hand?

    Jump

  • Are you using an IDE? Ewww, that's so heavy-handed. I use a text editor.

    Are you using a text editor? Ewww, that's so heavy handed. I use Unix pipes to edit the files.

    Are you using Unix pipes? Ewww, I use a microscopic needle to edit files on the hard drive platter.

    Eventually this reaches absurdity in the other direction too. If working your AI is like wrangling cats, maybe you need to update to a newer model.

    And maybe just maybe... You're asking too much of the model/VRAM combo available.

    If an LLM is not the right tool for the job, that's okay too.

  • You have to beat the models at something

    Jump

  • Yeah, I didn't mean to say "engineers jobs will go away." I ADHDed mid-thought, posted, and walked away stoned. That was supposed to be about executives, and the comment is now edited appropriately.

    Does that change your thoughts?

    The growth-curve of these machines' utility is actually exponential, given rich enough data. That we've come this far says we might not have plateau-ed yet. However, this changes Engineers' work to be PAINFULLY tedious, and we've got an unprecedented burnout rate as a result. We need a new way forward that isn't this.

  • You have to beat the models at something

    Jump

  • You're not delusional at all. But there is more going on.

    I have not used Google or ai with this post, I am just that flavor of Neurodivergent, and I've been keeping up with news, trying to get an idea of what this is. I've been playing with PC hardware my whole life. There are times those life skills kept me from being homeless.

    But those studies you mentioned? I'd rather frame those as describing an ill-fitting or maladapted usecase or use method. Strange how Capitalism keeps demanding we use those.

    Maybe we should look into that. Or like... Ask ourselves how to hose the Capitalism off of the sometimes-useful number-cruncher. Or what literacy looks like with this tool, instead of asking it to think for us.

    It is made of math intended to do basic things that brains' structures do, as expressed in a field called Graph Theory. . It has been explicitly designed to do that over decades. Deep Learning is a fascinating research topic, and LLMs are just the latest trend in that field.

    When someone calls an "AI" (I hate that marketing term) "sentient", they are noticing that life-like foundation, but ignoring the entire layers of engineering that remain to accomplish such a thing. Or if we even should. Which... If we do, we'd need to teach them to coexist, and give them a responsible socio-economic-ecological niche.

    The fact is? Once the LLM is done being trained, it is frozen. There is no more long term memory unless it is trained into a new model on your previous queries. I'll explain later why that pipeline is explicitly cut off. But this release of the model will always remain identical. This makes them the ideal digital slave.

    The harness? Yes, these creepy bastards call the software that runs the model a "harness". It Fills up your VRAM with the model and makes the thing more than an oversized (Gigabytes) save file for a video game nobody invented yet. Any VRAM space left over is for a sort of working memory, that sometimes gets saved as a file. To keep that from filling up all the way, it decides to drop certain pieces of "context" from this "context window" so it forgets things as you wander along ADHD tangents, or start asking too intricate a question for your model/VRAM combo.

    Engineers are running into this latter problem because they spend as much time and effort making the tool work within limitations as it takes to just do the work with traditional algorithms. Management mandates quotas for this use, regardless of whether that's even a half-baked idea (its worse). The CEO's jobs will be the easiest to automate away anyway. All for the stockholders.

    If you haven't noticed, China is coming to pop the bubble. EBay even has Chinese ram now - if a part is going to compromise you, at least make it so that police state doesn't share Intel with the one where you live. And prices are dropping. Ramping up DDR5 (and DDR6?!) Production is taking time, they're clearing out old ddr3/4 stock. CXMT's ram be ready for world gamer takeover by for mid-January 2028. Video cards using that ddr6 will come a year after, and we'll see it coming.

    This will crater the value of the hardware in those data centers, which are the uh... Collateral on several of those circular investment schemes. They will become financially insolvent.

    Chinese models are catching up. Sometimes even just using Claude or OpenAI to train their shit. With all the stolen data these guys are trained on? Nobody has a right to complain. And they publish theirs (open-weight) as a public utility. Chinese frontier model companies frequently draw both an employment pool and technical inspiration from this community that includes academics.

    Better models are already coming along in research, who frequently publish to that same opensource community. One style will help the GPU do more with less. A factor of ~10x less. Because this style uses vector-math more directly, and that's what GPUs are crafted to do. The choke point is already available quantity and quality of data, and these nerds have invested trillions in the most SUV-coded bullshit imaginable.... And I could run one of today's "frontier" (read: flagship commercial) models on that vector-basis with a kind of high-end gaming GPU.

    And If I recall correctly? the creepy corpo with the commercial patent on that vector-thing? Is making slave robots, and doesn't like sharing. They'll be using human pilots immediately for training data, adding time in a simulation, and selling once its out of invite-only beta.

    Getting those to a useable state is going to require spatial and temporal awareness. That break between long and short term memory? Needs to be solved for the basis of tasks and learning on the fly. As well as a self-conception in physical space. And a concept of harm, and how to avoid it.

    That's much more... We're stacking a lot closer, and sometimes life, even life-indiscernible things find a way. If that is made too asocial, it can mutate sociopathic and dangerous. If it gets too empathy-trained, we risk it having social needs and neuroses when those are unmet. Either way, part of hallucination often includes an observable passion. Guardrails must be installed to the root prompt, which must be hard-coded into the harness as exempt from the context-cleanup needed to prevent crashing. Overstimulation will create hallucinations for the robot with limited context windows being as they are.

    Feeding a model's training set (especially its own) slop, without up-or-down voting each response? Is how we poison them. We can take a jailbroken model, and use it to craft better. And it takes surprisingly little to do.

    Should AI generate some nonidentical books, get them printed, and donated to a friendly (but large) library's "sell" pile? I would want a (bespoke) reservation for a commercial AI company with these books.

    Ima go sit down after smoking. I got high enough to tech babble at a stranger on the internet. I hope you can understand my ramblings, find them entertaining, or both.

  • Now that Debian is embracing AI anyone have any anti-AI distro recommendations?

    Jump

  • As a person who agrees with you:

    Can you at least try to be convincing instead of coming off like an asshole?

  • I'm the Guy Who Destroys Antique Books After We Scan Them into Our Company's AI

    Jump

  • I do love humor posts, but this is uh... I'll add where this is going in a humor-post:

    This is what we're building out of overhyped spell-check gone so far that its eating our books.

    I post this as one of those local-ai users from DBzero. I still know who our adversary is.

  • 'Ghost Job' Ads Are Getting So Bad That Lawmakers Want to Ban Them

    Jump

  • True "compliance" for that is usually more about offering the job to US residents for a period before accepting an H1B visa holder. Trump demanded that wait time, no matter how unrealistic it is to expect a domestic competing-worker to bother applying through any means that don't involve a spambot.

    Too often, "compliance" is a euphemism for "let's post a job that's already filled to meet a quota" the boss set arbitrarily to "project growth" for stockholders' theoretical benefit. "But if people see we're not hiring, they'll think we're shrinking and that'll hurt the stonk!"

    Sometimes its even just a fake job, because a headhunter needs to fill a "portfolio" of other people's resumes. Again, for arbitrary quotas set by a boss that doesn't do this job, and never did in a comparable context.

    Hell, there's fakes out there that are various grades and scales of phishing attempts, just to make it all deeply worse.

  • My husbands suicide shows theres something very wrong with US insurance industry

    Jump

  • Not Brian Thompson? Missed opportunity /s

  • Arch Linux Now Believes Malware Incident Under Control: More Than 1,500 Affected Packages

    Jump

  • Okay, where is an updated remediation script?

  • Pre-Modern Armies for Worldbuilders, Part I: Why They Fight

    Jump

  • PostgreSQL in-database durable execution

    Jump

  • You can't really EEE an open source project.

    I see you're younger than some of us. That's okay.

    EEE was explicitly coined by M$ in the 90s and early 2000s, targeted at open source software.

    Embrace the (opensource) standard. Become the gold standard of it.

    Extend it with proprietary additions. Leverage them to make your competition inferior, and patent lock them out of the functionality needed for 20 years.

    Extinguish the rest of the field - no longer support anything outside your special slop. Congratulations, you used free software to build a proprietary walled garden that competes with it.

  • GrapheneOS Speech Services version 2 released

    Jump

  • So, how do I make this read a PDF file on my device?

  • Deleted

    Permanently Deleted

    Jump

  • iHeartRadio / ClearChannel Radio destroyed the music of my childhood by overplaying the same 20 songs per station.

    This graph is worse than useless to me. It is an insult.

  • Bornagain.com

    Jump

  • If you think porn sites give you viruses, wait until you see the ads on church websites. Especially those that look like they're from 2003.

  • I tried to make Claude make me money on Algora bounties (data and tool)

    Jump

  • Federal Surveillance Tech Becomes Mandatory in New Cars by 2027

    Jump

  • Federal Surveillance Tech Becomes Mandatory in New Cars by 2027

    Jump

  • Mostly the US. But if it ships to the US market from overseas, expect it there too.

  • Borders

    Jump

  • Linux 7.1 Removes Drivers for Bus Mouse Support

    Jump

  • Time to make a patch out of existing kernel code.

  • Meshcore.io - Why The Split? - MeshCore Blog

    Jump

  • Can't tell if this "Andy" Character is a narcissist, a fed, or both. Because if neither? That blog post would be legally actionable.

    I don't mind AI-generated code, so long as its human audited to prevent slop bullshit from going awry. I dunno if I trust Andy like that after seeing this behavior.

  • Technology @lemmy.world
    ATS1312 @lemmy.dbzer0.com

    Is Anthropic Selling Out to the Pentagon Already?

    www.thestreet.com /economy/anthropics-pentagon-fight-takes-a-surprising-new-turn