Post #2198902

ten years ago there was some interesting work on building deep classification models that not only made a classification but also made a confidence estimate (and not just taking the softmax score as a pseudo confidence). I wonder why something like that isn’t used for LLMs, maybe an auxiliary lighter weight LLM that’s been trained explicitly as a bullshit detector. A bit like LLM as a judge but more principled. (1/2)