The author describes the limitations of large context windows in LLMs, where attention drops off after 100k tokens, making them mostly a marketing number. To avoid this, the author uses a "breadcrumb approach" by writing and passing a spec to new sessions, keeping the working session in the smart zone.