Tokens and Billing / TOKEN WIKI
input token
In one sentence
Input Token is the amount of information read by the model in a model request, which usually includes context such as user questions, system prompts, historical conversations, and tools.
Why it matters
Multi-round applications may submit historical messages repeatedly, and the input cost will increase as the context grows.
Practical considerations
includes system prompts, retrieved documents and chat history into the test, and confirms whether cache hits are billed separately.
FAQ
Does entering the Token count only for this question?
also typically contains history and other context sent with the request, as measured by interface metering.
