github/DeepFaceLab
1
0
Fork 0
mirror of https://github.com/iperov/DeepFaceLab.git synced 2025-07-06 13:02:15 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove lrcos from adabelief

Browse source
This commit is contained in:
iperov 2020-12-11 20:34:14 +04:00
parent 26ed582aff
commit da058cf17f
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
models/Model_SAEHD/Model.py
View file

@ -285,7 +285,7 @@ Examples: df, liae, df-d, df-ud, liae-ud, ...
OptimizerClass = nn.RMSprop
if adabelief:
lr_dropout = 1.0
lr_cos = 2000
#lr_cos = 2000
OptimizerClass = nn.AdaBelief
clipnorm = 1.0 if self.options['clipgrad'] else 0.0