Skip Navigation

Posts
125
Comments
674
Joined
3 yr. ago

  • yeah lol I was gonna say they do but this place downvotes every AI did something good post to -100

  • There is a good point here:

    I don't understand one thing about Mistral, which I'm a fan being in Europe: they opened the open weights MoE show with Mixtral. Why are they now releasing dense models of significant sizes? In this way you don't compete in any credible space, nor local inference, nor remote inference since the model is far from SOTA and not cheap to serve. So why they are training such dense big models? Dense models have a place in the few tens of billion parameters, as Qwen 3.6 27B shows, but if you go 5 times that, it is no longer a fit, unless you are crushing with capabilities anything requiring the same VRAM, which is not the case.

    https://news.ycombinator.com/item?id=47949642

    but it is also le chat's main model now, so have to test it further and see how it goes!

  • It isn’t being done. Not at scale, nor is there any plans to do so

    There is here in Australia

    Adding to clean energy supply and minimising water footprints will become national expectations for new data centres built on Australian soil.

    https://reneweconomy.com.au/byo-renewables-new-national-principles-set-bar-for-data-centre-energy-and-water-use/

    There is in Europe:

    In Europe renewables and nuclear are set to supply most of the additional electricity required, with their combined share rising to 85% by 2030. Japan and Korea together account for about 5% of global data centre electricity demand today, a share they are expected to retain to 2030. Renewables and nuclear are set to provide nearly 60% of the electricity consumed by data centres in 2030, up from 35% today. The rest of the world is responsible for about 10% of total data centre electricity generation, with Southeast Asia and India accounting for a significant portion of that. In both regions, coal remains a key pillar of the data centre electricity supply, but renewables are projected to eclipse it by 2035.

    https://www.iea.org/reports/energy-and-ai/energy-supply-for-ai

    It's simple economics, renewables are the cheapest form of electricity so they want it, America != the world

    The fact that AI slop directly engages in hacking our brains, and filling our heads with junk data and hallucinations is not internally inconsistent.

    But how does being fed useful information, coding for us, providing interesting stories, a caring AI boyfriend or girlfriend lead us to enslavement? This is like suggesting we're slaves to McDonalds, it's feels less like slavery and more like hyperbole, especially with the existence of open source models...

    There isn’t even a suggestion of intention to give lip-service to the problem so fantasizing about it serves no purpose

    Speaking of open source models, happy release day of mistral medium!

    https://huggingface.co/mistralai/Mistral-Medium-3.5-128B

    It's from Mistral a french company!

    Today, as AI becomes increasingly integrated into every layer of our economy, it is crucial for developers, policymakers, enterprises, governments and citizens to better understand the environmental footprint of this transformative technology. At Mistral AI, we believe that we share a collective responsibility with each actor of the value chain to address and mitigate the environmental impacts of our innovations.

    https://mistral.ai/news/our-contribution-to-a-global-environmental-standard-for-ai

    Maybe there is a suggestion ?

  • ah, next time if you could be a bit clearer or ideally not respond at all that’d be great

    i prefer people who can argue not just throw shit

  • did you read the article? this doesn’t seem related at all

  • fair enough

  • what is promotional consideration?

  • Why aren’t leftists embracing the environmentally-destructive

    It's only as environmentally destructive as the environment in which it operates, if you train your AI in France using Nuclear power it is effectively carbon free training is it not? The biggest limitation on the carbon use of AI appears to be entirely limited to how fast or slow the USA transitions to renewable energy.

    If you run your LLM locally on a solar powered device is that not carbon free inference?

    the techbro billionaires are using to simultaneously enrich themselves and enslave humanity?

    enrich themselves? I thought AI was a massive money losing adventure bubble that was about to pop?

    enslave humanity? I thought AI was slop not worth of even being used because apparently all it does is hallucinate answers?

  • i need a new SSD and I'm just like fark moi 🤯

  • The average person wouldn’t be building an open source LLM either

    Yeah that's why I'm saying:

    Do you build your own Linux from scratch? If so why would you assume you can build an LLM from scratch?

    The OP is basically saying it's not really open source unless I can personally build it! Which I am saying I don't think is a requirement of open source software (your personal ability to compile software does not negate from it it's open sourceness)

    tbh I wouldn't have an idea on how to build either, they are way above my skill level, i have no idea how to make a linux distro either, but i'm certain most are open source

    Today, we’re launching Unsloth Studio (Beta): an open-source, no-code web UI for training, running and exporting open models in one unified local interface.

    https://unsloth.ai/docs/new/studio

    This was only recently released, maybe in the future we'll have training material uber compressed down in an open source format that anyone with the skill and knowledge can use and different 'distro' releases of LLM's, we already have tons of smaller models especially from European Universities and others

    The EuroHPC Joint Undertaking (JU) provides access to the computing time and support services offered by the EuroHPC AI Factories. The AI Factories are open to European users from various sectors, including industry, research, academia and public authorities.

    https://digital-strategy.ec.europa.eu/en/policies/ai-factories

    We are only like 3-4 years into AI going mainstream if that, afaik the heat death of the universe is at least 1000 years away, we have lots of time to work and improve on them, I can only wonder where they will be at in 100 years, so I try not to make any damning facebook boomer tier statements about the future

  • Because the average person is not building Linux from scratch nor would they know how to

  • But regardless, the main point of the gap is resources

    What makes you think we won't have the resources in the future?

    Any model that can run on 16GB or less, is not going to be any close in real world tasks, to any other cloud based model. It just cannot be.

    Well you can compare Gemma 4 running in LM Studio on an average gaming PC to ChatGPT3.5 and you tell me? Or is your benchmark purely based on right at this very moment between open source models today vs cloud today?

    For reference Gemma 4 is 26 billion parameters, gp3 thought to be over 175 billion and of course had no optimisations like MoE, it was searching its entire library every single question so was rather slow as well

    We know as well that there is no slow down in pushing for optimisations, Deepseeks initial release was the initial driver for you don't have to just scale up using hardware alone

    https://research.google/blog/turboquant-redefining-ai-efficiency-with-extreme-compression/

    They're also pushing with Chinese native chips from Huawei trying to diversify away from nvidia holding the crown

    The problem I've got is that you all have a god of the gaps, the conversation I was having 3 years ago was different to 2 years ago was different to 1 year ago, I was told AI could never do songs good enough then suddenly people were worried they couldn't tell the difference, then they said they could never do movies, now apparently not only is it good enough it's hilarious

    https://www.youtube.com/watch?v=fgHn7PI55J4

    The open source LLM's we have today are incredible and in the last few months we've had Qwen, GLM, Nemotron/Nvidia, Mistral, Google and heeaaps of others released, it feels like you're just looking for a reason to be dour and pessimistic but that's just me

    Any way I'm off to sleep, have a good one :)

  • I have no idea what you're talking about

  • When Ubuntu was just appearing I was using Debian. People laughed at me, saying I am a little bit slowpoke

    Why are you offended being called a slowpoke using slowpoke OS?

    I use it on my server because of this reason

    Now it looks like Ubuntu is starting to die

    Its been dead according to linux purists since 2011 when they went to Unity over Gnome or KDE so ignore them :P

  • He's remembering things from Ubuntu 12.10, yeah 14 years ago :)

  • yeah mistral is weak like that, I would say they're at least a year away from chatgpt and claude but they just don't have the compute

    I would recommend to use AI for basic games like translate sentence, anki style flash cards, fill in the sentence, eg. unlike duolingo it won't annoy the hell out of you with ads and energy