Download
1 variant available
fp16 SafeTensor
wlop_8badam_locon-000022.safetensors
Half precision, best balance • 14.57 MB
Verified: 3 years ago
8540 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 9
(151)
Mar 15, 2023
Other
Some
8bit Adam, with Locon.
768,768 with bs=2
$lr = "1e-4"
$unet_lr = "1e-4"
$text_encoder_lr = "1e-5"
$lr_scheduler = "cosine_with_restarts"
$lr_restart_cycles = 1
$conv_dim = 4
$conv_alpha = 4
$network_dim = 8
$network_alpha = 8
no reg
Show more

550 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 9
6540 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 9
I know someone made one before with only Lora.
This one use Locon!
This one use Locon!
This one use Locon!
I just use 8bit adam to train it, with all images i can find.
Actually I try Lion and 8bit-adam several times, this seems fine, not quite overfit.
Base is nai, my samples are from AOM2.
I only try 0.6~1, seems fine on AOM2.
Samples are picked, but I think most of images I got are still Ok, not too hard to find some good ones.
I did not try with NSFW tags, but you can try by yourself.
