The Context Window and Long Documents: Token Limits, Lost in the Middle, Long Context vs RAG
What is a context window? Token limits, the "lost in the middle" problem, long context vs RAG, and summarization chains (map-reduce, refine) explained with intuitive analogies.