ChatGPT and Long Conversations
A technical report has revealed that "ChatGPT" faces internal limitations that go beyond just the number of messages, extending to the model's ability to recall the entire conversation's context. These limits are based on what is known as the context window, which is measured in "tokens." As the conversation lengthens, the model begins to gradually forget parts of the dialogue, with some versions capable of handling around 128,000 tokens. Once this maximum is exceeded, messages indicate that the session has ended or the coherence of the responses deteriorates. Therefore, it is recommended to summarize the conversation and start a new session to maintain continuity.
Size: 120%Text Size
Notice: This Is an AI-Generated Summary
Comments (0)