Post #4305094
2026-07-24 12:08 UTC
I think it’s important to note that these models are open-WEIGHT and not open-SOURCE. Open-source would mean we could explore the training data itself. Open-weight models are great, but please let’s not call them open-source.
Replies (1)
-
@Meron35@lemmy.world 2026-07-25 03:39
Nemotron Ultra is a open source and already gives DeepSeek R1 performance (admittedly not that good anymore). NVIDIA has open sourced the entire training process, including raw datasets and synthetic data generation. The raw data is mostly curated web crawl data.