Token: Difference between revisions
Jump to navigation
Jump to search
(Created page with "A token is roughly a word, a punctuation, or a Unicode character in a prompt.") |
No edit summary |
||
| Line 1: | Line 1: | ||
A token is roughly a word, a punctuation, or a Unicode character in a prompt. | A token is roughly a word, a punctuation mark, or a Unicode character in a [[prompt]]. | ||
Latest revision as of 15:18, 11 October 2023
A token is roughly a word, a punctuation mark, or a Unicode character in a prompt.