Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)S
Posts
0
Comments
161
Joined
3 yr. ago

  • Thanks for your experience! I'm in a similar boat regarding NVIDIA - plus the budget ...

    At least in Europe the V100 are only available from China and with a huge markup.

    Used 5090 for 3,5k, even a 3060 used is still at 250$ plus.

    It's crazy at the moment - I simply can't afford self hosting LLMs which is a new thing to say :D

  • Yeah, there are modules at least for fillets! But I'm really a non visual person who just wants functional stuff, I'm not knowledgeable enough when it comes to any special features.

    For example I have no idea what "such tools" entails :D

  • I mean good for anyone who's into this - for me, I'll stick with openscad though ( https://openscad.org/ ).

    Same thing but with a dedicated language dedicated to 3D modeling, algebraic approach to shapes and a long history and track record.

  • Deleted

    Permanently Deleted

    Jump
  • In case you wanna give it a shot: I gave writing samples of myself from chat and emails to a self hosted LLM, telling it to extract the writing style deviations, key elements, common phrases, symbols, patterns, etc. Then gave that as a "answer it this style" system prompt expansion - works like ... Quite okay. Still need to go over it or course but it doesn't sound like marketing bullshit but conveys what I want.

    Completely agree with your general assessment though! They're getting better but the marketing machinery is crazy in their claims.

  • Because physically speaking, chaotic and unpredictable are two different things - and why it works so well on this case: it's becoming a stochastic problem, not a deterministic one.

    It's an awesome area for machine learning: you didn't need to understand the result and how it got created, it just needs to be "close enough".

  • Oh I completely agree with that, just the jump to "a flawed model leaked" is too far. There's already enough crap to mock, no need to make up additional stuff.

  • It's bullshit. What leaked was their commandline tool source code (named "claude code") - very juicy in itself but has nothing to do with their models.

  • I tried more "niche from a popular perspective". You're right, especially alpine is in the background of a lot of docker containers but rarely an end user who just want their desktop environment knows them.

    For nixos I've not yet seen anyone in the enterprise world pushing for it - there it's still all about containerization and orchestration in cloud environments, using that as reproducibility layer. That might change though with data sovereignty discussions going on.

  • I can see where you're coming from! Specifically this community though I've not seen it a lot - you're completely right though, the more native one becomes the more one is confronted with it.

    I'm still struggling with the slowness of things (e.g. a quick endpoint change) and I can't get my head around reason error messages "fluently", i.e. I have to think about what the errors want to tell me instead of resolving it - a bit like old python stuff really.

    And then there are the edge cases ..... It took me a long time to change the config the very first time while offline - which makes sense from a model perspective but from my user brain it was just ... wrong :D

    Perhaps I should switch my clients as well to get more exposure....

  • In addition to alpine id also throw nixos in.

    It's a real niche OS with a very different approach to setup and configuration than any other I've seen and tested. It's now my server Linux and after more than a year I'm still not sure if I would recommend it 😂

  • If you are truly serious: this is not how hallucinations work. It's really best to think of it as "fancy auto complete". The hallucinations happen when the next token is too disconnected from what we as humans would call as "belonging together". But it's all math after all.

    Limit the k value, tube down temperature and cut off context size and the issue of hallucinations is a non-topic for "transcribe and summarize".

    You get into what I'd call "stupid" territory like you're describing.


    Your second point I fully agree with and is the reason why I'd ask the doc directly. To give the personal anecdote: the transcript itself helps me to focus on exactly the topics you've described: who's confused? Where was agreement? Where did people just not speak up?

    A specific hallucination example I see every other day for example are tasks: that thing "thinks" that "we should" or "you must" are always tasks and outcomes which is utter bullshit - but I know that and using the transcript part helps me focus on the important part, the humans.

  • Counter top the popular opinion here for me it would be a clear yes in the situation you're describing.

    The relationship with my direction doc is more believable to me than principles of vague bad feelings for me.

    Now taking and transcripts specifically are one of the use cases I also draw value out myself. I'd ask the doc though how they're using it.

    Still I'd rather have my transcript public than to go on that search for a doctor match again.

  • They (US politics) literally do though, right? At least that's my impression as a non US person.

    If my understanding is correct it would need an overhaul of the constitution to change that, right? (The part about representatives of states cascading to select the representatives who then select the boss).

    I'm quite uneducated though in US politics so perhaps I've got something completely wrong!

  • Oh but that happened already! And is still ongoing.

    For a long article about it, Wikipedia has us covered:

    https://en.wikipedia.org/wiki/Artificial_intelligence_and_copyright

    The very first litigation, Doe v. GitHub, Inc. is about training on copyrighted material but they're touching on the copyright of output as well and connection to DMCA 1202. The leak pushed GitHub and anthropic - and by proxy Microsoft and OPEN AI - hopefully in a lose/lose situation. Although the lawsuits are already taking years and I would be at least as shocked as I'm cynical if the whole fiasco ended in a "rules for thee but not for me" situation - again.

  • Not surprising but surely newsworthy:

    That they also seem to dmca the forks which were GenAI based rewrites, creating a precedence that this is, in fact, not enough to no longer have copyright applied - an argument that both anthropic and Microsoft/GitHub used in the past.

  • "Sag Mal Du als Richterin", but it's locked away behind the audible paywall sadly.

  • Oh yeahz you're right from what I know! Reference cases are used, at least in Germany, all the time, especially looking at the closing argument of the judgment itself (according to that one judge podcast I listen to which makes me an internet expert, doesn't it?).

    Good point!

  • In Europe I'm now aware of any common law or precedence law approaches so even if there'd be a case like you described (which I would be interested in!) it wouldn't have binding qualities for the bullshit that onlyoffice is pulling off.

    Dipshits.