If you run Nemotron, from open datasets. See the dataset table here. There are sections for pretraining and for specific tasks/topics, like STEM, code and such: huggingface.co/nvidia Chinese models are starting to open their pretraining datasets too, albeit slowly.