Post #673815

Many models produce outputs that are hard to verify for an end user. 🏆 Our new #emnlp2023 paper won an outstanding paper award for showing that a secondary quality estimation model can help users decide when to rely on the model output. We ran a controlled experiment showing that a calibrated quality estimation model can make physicians twice better at correctly deciding when to rely on a translation model output. Paper: https://arxiv.org/pdf/2310.16924v1.pdf