Skip to content

My document is longer than the context window

Short answer

This is normal and mostly handled: Nightjar retrieves the relevant passages rather than loading the whole file. Narrow questions work; whole-document questions do not.

Why this happens

The context window holds a few thousand tokens, and a long report holds far more. Retrieval selects passages to fit, which means the model never sees the whole document at once.

What to do

  1. 01Ask narrow questions. “What is the notice period in clause 11?” works; “summarise this 300-page report” cannot.
  2. 02Use the document's own vocabulary so retrieval picks the right passages.
  3. 03Start a fresh conversation for a new document — old history competes for the same window.
  4. 04If you have the VRAM, a larger model with a longer window helps, but retrieval quality matters more than window size here.

Other ways people ask this

  • nightjar document is longer than the context window
  • Nightjar Browser: document is longer than the context window. How do I fix it?

Related