Tokenizer: Difference between revisions
Jump to navigation
Jump to search
(Created page with "The process/model through which text prompts are turned into tokens, for processing.") |
No edit summary |
||
Line 1: | Line 1: | ||
The process/model through which text prompts are turned into tokens, for processing. | The process/model through which text [[Prompt|prompts]] are turned into [[Token|tokens]], for processing. |