The overview of RAG
A curated list of resources dedicated to retrieval-augmented generation (RAG).
The retrieval-augmented generation (RAG) is to combine the merits of retrieval system and llm to generation high-quality answers for users.
The Framework for RAG System
Typically, the rag system consists of a set of modules, where each task are described as follows:
- Interpreter: This component focuses on refining and enriching the user’s initial query or question to improve the subsequent retrieval process. By generating more detailed or expanded search queries, it helps the retrieval component to more effectively recall relevant documents.
- Retriever: This component is responsible for finding and fetching relevant documents or passages from a large corpus based on the refined user query. It acts as the primary information access layer, providing the foundational knowledge for the generation phase.
- Compressor: This component processes the retrieved documents and user questions to create an optimized context for LLM. It aims to refine, condense, and organize the retrieved information, ensuring that the most pertinent and concise context is passed on for accurate generation.
- Generator: This component leverages a LLM to synthesize a coherent, informative, and contextually relevant answer based on the user’s question and the provided refined contexts. It transforms raw information into a human-readable response.
- Validator: This component aims to improve the trustworthiness and quality of the generated answer by validating its accuracy and adherence to factual information within the provided contexts. It ensures the output is reliable and grounded.
- Evaluator: This component measures the overall performance and quality of the RAG system, assessing various aspects such as answer accuracy, retrieval effectiveness, and generation faithfulness. It provides metrics to understand and improve the system’s capabilities.
Surveys
- The Organization column only record the organization of the first author.
Systems
- The Organization column only record the organization of the first author.
