Trust Me on This: A User Study of Trustworthiness for RAG Responses
Topics: Krisztian Balog, LLM Readability, LLMO / GEO, Passage based retrieval, Retrieval Augmented Generation (RAG)
This Google paper presents a controlled user study examining how different types of explanations affect user trust in responses generated by Retrieval-Augmented Generation (RAG) systems. The researchers tested three explanation types — source attribution, factual grounding, and information coverage — by having participants choose between a high-quality and a lower-quality response, first without explanations and then with them. The key finding is that while explanations do guide users toward higher-quality responses, trust is not purely driven by objective quality: factors like response clarity, actionability, and the user’s own prior knowledge play a significant role in trust judgments.
