Post #2547543
2026-05-03 15:39 UTC
@philipncohen@mastodon.social someone pretends to have collected original data through a survey or some other data analysis method. This would make reproduction impossible without a data-sharing mandate.
2) We may see vibe-coded quantitative analysis sooner or later (maybe someone knows an example already). This means a dataset is feed into an LLM and the results are based on prompts only. The LLM would be able to produce code that supposedly would produce the results if used in R, Python whatever. 3/
Replies (1)
-
@ingorohlfing@mastodon.social 2026-05-03 15:43
@philipncohen@mastodon.social Unless the researcher validates this, which is imo more unlikely than likely if one does a prompt-based analysis in the first place, the code is worth nothing. Plus the findings may be non-reproducible by the original researcher when the LLM is altered, which happens regularly, I think. With mandatory code sharing, this would be relatively easy to detect once a third party tries to verify the findings. Regardless, would be interesting to know why ASA has no policies adopted. 4/