Post #3891085

@tyzbit@toot.now We are actually digging quite a lot in the topic. Academic papers claiming open source models and then you cannot get access to the original recipe is driving me nuts too. The reproducibility is usually hard to evaluate if you don’t have some H100 cards laying in your racks… but I see that more and more models are releasing details to reproduce the training steps. I remain optimism for the future while the model training will become more accessible on smaller hardware.