3 / 5

Lesson · 12 min

Working memory and the window

Long context is real. Attention is not uniform. Old instructions fade.

Current Grok flagship models accept very large contexts — on the order of hundreds of thousands of tokens. You can paste a lot. You should still not paste a lot by default. Models attend unevenly. Instructions in the middle of a haystack get lost. Costs scale with what you send, every turn.

  • Put the load-bearing rules at the top and restate them when the thread is long.
  • Prefer the relevant excerpt over the whole PDF.
  • When the conversation changes job, start a new thread.