Commit graph

62 commits

Author SHA1 Message Date
Josh Johnson
e2bc65d5f0 Fix issue with RTX GPU and TensorFlow (#322)
An issue affecting at least 2070 and 2080 cards (possibly other RTX cards too) requires auto growth to be enabled for TensorFlow to work.

I don't know enough about the impact of this change to know whether this ought to be made optional or not, but for RTX owners, this simple change fixes TensorFlow errors when generating models.
2019-08-02 16:40:41 +04:00
fakerdaker
582c974851 Colab choose random preview (#316) 2019-07-25 11:29:31 +04:00
iperov
8484060e01 Trainer: added option for all models
Enable autobackup? (y/n ?:help skip:%s) :
Autobackup model files with preview every hour for last 15 hours. Latest backup located in model/<>_autobackups/01

SAE: added option only for CUDA builds:
Enable gradient clipping? (y/n, ?:help skip:%s) :
Gradient clipping reduces chance of model collapse, sacrificing speed of training.
2019-06-20 10:42:55 +04:00
Jakob6174
ea1d59f620 Update ModelBase.py (#283)
Typo: 'NotImplementeError' --> 'NotImplementedError'
2019-06-19 13:02:19 +04:00
iperov
66a12a973a fix choosing preview image on options override 2019-05-14 17:00:25 +04:00
iperov
d6e8dde481 'sort by yaw' option now can be overriden each run 2019-05-14 09:33:53 +04:00
iperov
2a8dd788dc SAE: added option 'Pretrain the model?',
Pretrain the model with large amount of various faces. This technique may help to train the fake with overly different face shapes and light conditions of src/dst data. Face will be look more like a morphed. To reduce the morph effect, some model files will be initialized but not be updated after pretrain: LIAE: inter_AB.h5 DF: both decoders.h5. The longer you pretrain the model the more morphed face will look. After that, save and run the training again.
2019-05-01 19:55:27 +04:00
iperov
efb22ecce0 5 secs for override settings for colab 2019-04-30 07:32:15 +04:00
iperov
836693d64f added option 'Choose image for the preview history? (y/n skip:' 2019-04-27 10:03:54 +04:00
iperov
e1da9c56b4
SAE collapse fix (#245)
* test

* _

* _

* upd dev_poseest

* SAE: finally collapses are fixed

* fix batch size help
2019-04-24 09:38:26 +04:00
iperov
ea7ec74721 change help for batch size 2019-04-23 18:31:12 +04:00
iperov
3aef9a507b fix 2019-04-22 00:52:16 +04:00
iperov
44aa530fda multiple preview file support for colab 2019-04-22 00:49:50 +04:00
iperov
093ca4dba6 fix options in ModelBase.py 2019-04-21 21:08:45 +04:00
iperov
8e16f4fa1b fix 2019-04-20 16:10:58 +04:00
iperov
3ffdc50576 nothing interesting 2019-04-20 15:22:00 +04:00
iperov
5ac7e5d7f1 changed help message for pixel loss:
Pixel loss may help to enhance fine details and stabilize face color. Use it only if quality does not improve over time.

SAE:
previous SAE model will not work with this update.
Greatly decreased chance of model collapse.
Increased model accuracy.
Residual blocks now default and this option has been removed.
Improved 'learn mask'.
Added masked preview (switch by space key)

Converter:
fixed rct/lct in seamless mode
added mask mode (6) learned*FAN-prd*FAN-dst

added mask editor, its created for refining dataset for FANSeg model, and not for production, but you can spend your time and test it in regular fakes with face obstructions
2019-04-04 10:22:53 +04:00
iperov
3cf3bb786e rename samples to samplelib 2019-03-27 10:44:13 +04:00
iperov
070e938568 colab: final fix for preview filepath 2019-03-26 18:11:33 +04:00
iperov
e8a5a4bf10 _preview.jpg for colab 2019-03-26 17:58:29 +04:00
iperov
6241c8af41 preview file for colab 2019-03-26 17:14:59 +04:00
iperov
b03b147bae refactoring 2019-03-26 11:09:44 +04:00
iperov
131b2b5c79 after save loss string now shows averaged value since last save 2019-03-25 18:14:04 +04:00
iperov
a3df04999c removing trailing spaces 2019-03-19 23:53:27 +04:00
iperov
034ad3cce5 upd fan segmentator 2019-03-19 19:44:14 +04:00
iperov
5076feb90f SAE: revert back to sigmoid. Trainings must be restarted. 2019-03-16 09:01:11 +04:00
iperov
8da47fec13 fix ModelBase, nnlib 2019-03-13 20:53:59 +04:00
iperov
a9026ccb67 fix ModelBase, nnlib 2019-03-13 19:50:16 +04:00
iperov
58763756f5 SAE: removed simple_optimizer . Added optimizer mode for tensorflow only (NVIDIA cards), allows to train x2-x3 bigger networks with normal Adam optimizer, consuming VRAM and CPU power. 2019-03-13 11:54:17 +04:00
iperov
3c6775bae7 fix ModelBase.py 2019-03-12 23:22:58 +04:00
iperov
97b6fabaab change 'epoch' to 'iter',
added timestamp prefix to training string
2019-03-12 19:23:52 +04:00
iperov
46ff33bf89 SAE: dssim kernel size now depends on resolution 2019-03-12 09:49:40 +04:00
iperov
ee8dbcbc35 revert back Adam 2019-03-11 21:52:36 +04:00
iperov
e4637336ef added ability to save optimizers states which work with K.function,
added custom Adam that can save 'iterations' param
2019-03-11 18:23:01 +04:00
iperov
438213e97c manual extractor: increased FPS,
sort by final : now you can specify target number of images,
converter: fix seamless mask and exception,
huge refactoring
2019-02-28 11:56:31 +04:00
iperov
a858732b1d refactoring 2019-02-21 20:06:04 +04:00
iperov
97685ce0ae added saving model_summary.txt 2019-02-21 19:55:44 +04:00
iperov
f0a20b46d3 SAE: added new archi 'vg' 2019-02-21 17:53:59 +04:00
iperov
72ba6b103c added support of AMD videocards
added Intel's plaidML backend to use OpenCL engine. Check new requirements.
smart choosing of backend in device.py
env var 'force_plaidML' can be choosed to forced using plaidML
all tf functions transferred to pure keras
MTCNN transferred to pure keras, but it works slow on plaidML (forced to CPU in this case)
default batch size for all models and VRAMs now 4, feel free to adjust it on your own
SAE: default style options now ZERO, because there are no best values for all scenes, set them on your own.
SAE: return back option pixel_loss, feel free to enable it on your own.
SAE: added option multiscale_decoder default is true, but you can disable it to get 100% same as H,DF,LIAEF model behaviour.
fix converter output to .png
added linux fork reference to doc/doc_build_and_repository_info.md
2019-02-19 17:33:12 +04:00
iperov
4d37fd62cd fix DFLJPG,
SAE: added "rare sample booster"
SAE: pixel loss replaced to smooth transition from DSSIM to PixelLoss in 15k epochs by default
2019-02-09 18:53:37 +04:00
iperov
ea7c65c4e5 upd ModelBase.py 2019-02-07 22:38:31 +04:00
iperov
a65b557b0e loss history with epoch now saves to preview history images 2019-02-07 22:34:51 +04:00
iperov
5a1fb199f4 added support of non-english characters in paths 2019-02-05 19:33:55 +04:00
iperov
ef3cf392c5 SAE: added pixel loss option. 2019-01-25 09:56:40 +04:00
iperov
1e7a0836f7 nothing interesting 2019-01-24 21:28:54 +04:00
iperov
1f2b1481ef now you can train models on multiple GPU's on same workspace without cloning any folders.
Model files names will be prefixed with GPU index if GPU choosed explicitly on train/convert start.
if you leave GPU idx choice default, then best GPU idx will be choosed and model file names will not contain index prefix.
It gives you possibility to train same fake with various models or options on multiple GPUs.

H64 and H128: now you can choose 'Lighter autoencoder'. It is same as vram gb <= 4 before this update.

added archived_models.zip contains old experiments

RecycleGAN: archived

devicelib: if your system has no NVML installed (some old cards), then it will work with gpu_idx=0 as 'Generic GeForce GPU' with 2GB vram.

refactorings
2019-01-14 10:48:23 +04:00
iperov
2473dabf37 fix loss history 2019-01-11 19:19:29 +04:00
iperov
e6fa021c3d fix prompt override model settings in convert mode 2019-01-11 11:29:18 +04:00
iperov
e39d1a2619 fixes 2019-01-10 23:01:33 +04:00
iperov
bd2b575718 fix ModelBase.py 2019-01-10 19:38:31 +04:00