Token
The unit models actually read — subword chunks, roughly ¾ of an English word each. Context windows, pricing, and rate limits are all denominated in tokens.
The unit models actually read — subword chunks, roughly ¾ of an English word each. Context windows, pricing, and rate limits are all denominated in tokens.