To avoid the "lost in the middle" effect in long ChatGPT prompts, I'm trying to find the exact safe token limit. The AI gave me inconsistent estimates, and I'm worried because my long-term project will require around 125k tokens (~500k characters). Has anyone figured out the real safe limit?
[link] [comments]