Sampling (temperature / top-p)
The randomness controls of generation. Temperature reshapes the token distribution; top-p truncates it to the most probable set. Near-zero for extraction and code; higher for creative work.
The randomness controls of generation. Temperature reshapes the token distribution; top-p truncates it to the most probable set. Near-zero for extraction and code; higher for creative work.