Post #3891088
2026-07-17 15:43 UTC
@adulau@infosec.exchange I say this with respect and after searching earnestly myself - what large language models are open source? DeepSeek? Qwen? Those aren't open source, although the term has been used for them. Open source means releasing all of the artifacts you need to build your own, and I don't know of a single mainstream LLM that also released the training data used. Again, respectfully and not trying to sealion, do you know of any mainstream models like this?
If there isn't any, both proprietary and open-weight models are outside the reach of individuals without a large corpus of training data and are effectively the same: something you rely on others to make for you. The only difference is open models can be shared.
Replies (1)
-
@adulau@infosec.exchange 2026-07-17 17:19
@tyzbit@toot.now There are different ones at different level of open-source but there are some which are indeed including all the training recipes including dataset and even checkpointing: https://github.com/NVIDIA-NeMo/Nemotron Nemotron is maybe one of the good example.https://github.com/allenai/olmo-core Olmo is another example. There are many more but those are actually working ones and other already reproduced the training process.