Is RAG dead?
What is RAG?
RAG is a fancy way of stuffing additional information into the prompt of a language model. By giving the model more information, we can get more contextual responses that are contextually relevant to what we need. But don't language models already have access to all of the world's information?
Imagine you're starting a new job. Would you rather:
- Have access to all of Wikipedia and hope the information you need is somewhere in there
- Have your company's specific documentation, procedures, and guidelines