All Lessons

A legal technology company is building a document analysis system that processes 900K-token legal contracts. The CTO wants to ensure the chosen Claude model can handle the full document in a single request without chunking. The team is evaluating Claude Sonnet 4.6 against other models in the family. If Sonnet 4.6 supports a 1M-token context window, which approach best validates this capacity for their use case before committing to the architecture?

1 / 3
intermediate 25 min

Context Window Management

Loading lesson content...

A fintech startup is designing an AI-powered customer support agent. The engineering lead allocates 50K tokens for the system prompt (including compliance disclaimers), 20K for conversation history, 10K for few-shot examples, and leaves the rest for the customer's current issue. The system prompt alone consumes 50% of the 200K context window. The lead is concerned this allocation will leave insufficient room for processing complex support tickets. What concept describes the strategic allocation of context window space across these competing sections?

1 / 1

A chatbot sends the full 6-month conversation history with every request. Latency and costs are high. Best architecture?

1 / 3