Tokenizer

From Civitai Wiki
Revision as of 15:19, 11 October 2023 by Civitai (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

The process/model through which text prompts are turned into tokens, for processing.