Tokenizer: Difference between revisions

From Civitai Wiki
Jump to navigation Jump to search
(Created page with "The process/model through which text prompts are turned into tokens, for processing.")
 
No edit summary
 
Line 1: Line 1:
The process/model through which text prompts are turned into tokens, for processing.
The process/model through which text [[Prompt|prompts]] are turned into [[Token|tokens]], for processing.

Latest revision as of 15:19, 11 October 2023

The process/model through which text prompts are turned into tokens, for processing.