Week 1 · D1🔒 LockedAbout 4 hours
Why Retrieve at All: Hallucination, Knowledge Cutoffs, and the Cost of Long Context; a Minimal Keyword-Only RAG
First get clear on the three specific problems Retrieval-Augmented Generation actually solves for a model, weigh it against fine-tuning and very long context on cost and fit, then write your first working question-answering system with BM25 scoring, without touching a single vector.
First get clear on the three specific problems Retrieval-Augmented Generation actually solves for a model, weigh it against fine-tuning and very long context on cost and fit, then write your first working question-answering system with BM25 scoring, without touching a single vector.
Interview questions
When should you use retrieval-augmented generation, when should you fine-tune, and when is stuffing the documents into the context window good enough?什么时候该用检索增强生成,什么时候该微调,什么时候直接把文档塞进上下文就够了?
Common in ChinaCommon overseasBasic#rag-basics#fine-tuning#long-context🔒 Unlock this chapter to see the answer keys.
In BM25, what problems do term-frequency saturation and document length normalization each solve? What happens if you set both k1 and b to zero?BM25 里的词频饱和与文档长度归一化分别在解决什么问题?把 k1 和 b 都设成 0 会发生什么?
Common in ChinaCommon overseasIntermediate#bm25#ranking#information-retrieval🔒 Unlock this chapter to see the answer keys.
A retrieval-augmented generation system gave a wrong answer. How do you determine whether retrieval or generation is at fault?一个检索增强生成系统答错了,你怎么定位是检索的锅还是生成的锅?
Common in ChinaCommon overseasIntermediate#debugging#failure-modes#evaluation🔒 Unlock this chapter to see the answer keys.
Context windows are now in the millions of tokens. Does that make the retrieval step obsolete?上下文窗口已经做到上百万 token 了,检索这一步会被淘汰吗?
Common in ChinaCommon overseasDeep dive#long-context#cost#system-design🔒 Unlock this chapter to see the answer keys.
