Post #2360011

‘Someone sent me a link to this paper “Can LLMs Act as Historians? Evaluating Historical Research Capabilities of LLMs via the Chinese Imperial Examination”  Gao et. al. are trying to get LLM’s to demonstrate high order skills in historical reasoning, using a new benchmark ProHist-Bench. They determine, that no, they can’t. LLM’s still hallucinate, and more importantly, they answer questions wrong. My problem is not that they get questions wrong, but that the people doing this don’t seem to know what doing history is.’ https://froginawell.net/frog/2026/05/want-to-ai-proof-your-degree-study-history/ @histodons