Temperature
Short answer
Temperature controls how much randomness goes into choosing each next word. Low values make the model repetitive and predictable; high values make it creative and unreliable.
At temperature 0 the model always takes the most likely next token, which is what you want when asking it to pull a figure out of a table. Higher values help with drafting prose and hurt everywhere else.
For a browser assistant the useful setting is low. You are asking what a document says, and a question with a correct answer should not be answered differently each time you ask.
Related terms
Other ways people ask this
- what is temperature