Context Window
The total amount of tokens (words and characters) that an artificial intelligence model can retain, read, and process in a single inference call, defining its short-term memory capacity.
Definitive concepts, acronyms, and technical definitions in our industry.
The total amount of tokens (words and characters) that an artificial intelligence model can retain, read, and process in a single inference call, defining its short-term memory capacity.