Network Alpha

From Civitai Wiki
Revision as of 07:50, 11 October 2023 by Civitai (talk | contribs) (Created page with "Closely related to the Network Rank (Dimension), the smaller the Network Alpha value, the larger the LoRA neural net weights. Can be used to Dampen, or "slow down" learning. Alpha of 16 and Network Rank (Dim) of 32 halves the Learning Rate. If Alpha and Network Rank are set to the same value, there will be no effect on Learning Rate. Category:Training")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Closely related to the Network Rank (Dimension), the smaller the Network Alpha value, the larger the LoRA neural net weights. Can be used to Dampen, or "slow down" learning. Alpha of 16 and Network Rank (Dim) of 32 halves the Learning Rate. If Alpha and Network Rank are set to the same value, there will be no effect on Learning Rate.

Retrieved from "http://wiki.civitai.com/index.php?title=Network_Alpha&oldid=207"