Releases: kozistr/pytorch_optimizer
Releases · kozistr/pytorch_optimizer
pytorch-optimizer v0.1.1
weight decay ban list
pytorch-optimizer v0.1.0
Bump minor version to 0.1.0
pytorch-optimizer v0.0.11
Implement PCGrad
pytorch-optimizer v0.0.10
- Support GC on
AdamP
optimizer : code
pytorch-optimizer v0.0.9
Implement DiffRGrad optimizer
pytorch-optimizer v0.0.8
Implement DiffGrad optimizer
pytorch-optimizer v0.0.7
Improve MADGRAD optimizer
pytorch-optimizer v0.0.6
- Implement Sharpness-Aware Minimization (SAM) optimizer
- Support Adaptive SAM
pytorch-optimizer v0.0.5
- Combine
AdaBoundW
intoAdaBound
optimizer withweight_decouple
parameter. - Implement
AdaBelief
optimizer- Support fp16
- Support
weight_decouple
withAdamW
scheme - Support rectified update similar to
RAdam
pytorch-optimizer v0.0.4
Implement AdaBound/AdaBoundW optimizers