Unfamiliar Finetuning Examples Control How Language Models Hallucinate

Descripción general

Resumen del artículo

This paper finds that unfamiliar examples in an LLM's finetuning data significantly influence its hallucinations, with the model's predictions mirroring responses associated with these examples. This suggests that manipulating the finetuning data could steer the model towards more desirable responses, like expressing uncertainty when it doesn't know.

Explícamelo como si tuviera cinco años

When large language models (LLMs) make things up, they often repeat stuff they learned during training, even if it's wrong. By changing their training, we can make them better at admitting when they don't know something.

Posibles conflictos de intereses

None identified

Limitaciones identificadas

Explicación de la calificación

This paper presents a novel perspective on how LLMs hallucinate and offers a potential solution through conservative reward models. While the focus on QA tasks and the limited scope of unfamiliarity are limitations, the core findings and the proposed approach are valuable contributions to the field.

Conviene saber

Este es el análisis de Starter. Paperzilla Pro verifica cada cita, investiga los antecedentes de los autores y las fuentes de financiación, y utiliza razonamiento avanzado con IA para ofrecer información más exhaustiva.

Jerarquía temática

Información del archivo