Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)P

Prunebutt

@ Prunebutt @slrpnk.net

Posts
8
Comments
396
Joined
3 yr. ago

  • About as open source as a binary blob without the training data

    Jump

  • Yet another so-called AI evangelist accusing others of not understanding computer science if they don't want to worship their machine god.

  • About as open source as a binary blob without the training data

    Jump

  • Yes. The training data is probably a few hundred petabytes.

  • About as open source as a binary blob without the training data

    Jump

  • There were e|forts. Facebook didn't like those. (Since their models wouldn't be considered open source anymore)

  • About as open source as a binary blob without the training data

    Jump

  • You downloaded the weights. That's something different.

  • About as open source as a binary blob without the training data

    Jump

  • They could disclose how they sourced the training data, what the training data is and how you could source it. Also, did they publish their hyperparameters?

    They could jpst not call it Open Source, if you can't open source it.

  • About as open source as a binary blob without the training data

    Jump

  • Did "they" publish the training data? And the hyperparameters?

  • About as open source as a binary blob without the training data

    Jump

  • Great, so we agree. ᕕ(ᐛ)ᕗ

  • About as open source as a binary blob without the training data

    Jump

  • Creative commons and MIT licence are distinct, though.

  • About as open source as a binary blob without the training data

    Jump

  • It's constantly referred to as "open source".

  • About as open source as a binary blob without the training data

    Jump

  • You don°t have access to the source.

  • About as open source as a binary blob without the training data

    Jump

  • So the models aren't opn source 🙄

  • About as open source as a binary blob without the training data

    Jump

  • Tutorials won't disclose the data used to train the model.

  • About as open source as a binary blob without the training data

    Jump

  • everything is open source, with the exception of the data

    If I distribute a set consisting of emulator and a Rom of a closed source game (without the sourcecode), then the full set is not open source.

    So if deep seek removed its data set, would you then consider deepseek open source?

    Kind of, but that's like expecting a console without any firmware. The Weights are the important bit of an LLM distribution.

  • About as open source as a binary blob without the training data

    Jump

  • So an emulator can’t be open source if the methodology on how the developers discovered how to read Nintendo ROM’s was discovered?

    No. The emulator is open source if it supplies the way on hou to get the binary in the end. I don't know how else to explain it to you: No LLM is open source.

  • About as open source as a binary blob without the training data

    Jump

  • About as open source as a binary blob without the training data

    Jump

  • it’s the entirety of the bulk unfiltered data you want

    Or more realistically: a description of how you could source the data.

    doesnt touch on at all how this LLM is different from other LLM’s?

    Correct. Llama isn't open source, either.

    like saying that an open source game emulator can’t be open source because Nintendo games are encapsulated

    Not at all. It's like claiming an emulator is open source, because it has a plugin system, but you need a closed source build dependency that the developer doesn't disclose to the puplic.

  • About as open source as a binary blob without the training data

    Jump

  • It's still not open source. No matter how extendable the weights are.

  • About as open source as a binary blob without the training data

    Jump

  • So, Ocarina of Time is considered open source now, since it's been decompiled by the community, or what?

    Community effort and the ability to build on top of stuff doesn't make anything open source.

    Also: initial training data is important.

  • About as open source as a binary blob without the training data

    Jump

  • The point of open source is access to reproducability the weights are the end products (like a binary blob), you need to supply a way on how the end product is created to be open source.