Skip to content

Releases: kozistr/pytorch_optimizer

pytorch-optimizer v0.1.1

09 Oct 11:59
2d4c3c6
Compare
Choose a tag to compare
weight decay ban list

pytorch-optimizer v0.1.0

06 Oct 13:37
49d3937
Compare
Choose a tag to compare
Bump minor version to 0.1.0

pytorch-optimizer v0.0.11

06 Oct 13:27
Compare
Choose a tag to compare
Implement PCGrad

pytorch-optimizer v0.0.10

25 Sep 13:25
Compare
Choose a tag to compare
  • Support GC on AdamP optimizer : code

pytorch-optimizer v0.0.9

23 Sep 10:32
bc22b00
Compare
Choose a tag to compare
Implement DiffRGrad optimizer

pytorch-optimizer v0.0.8

23 Sep 06:40
5113c54
Compare
Choose a tag to compare
Implement DiffGrad optimizer

pytorch-optimizer v0.0.7

22 Sep 13:52
Compare
Choose a tag to compare
Improve MADGRAD optimizer

pytorch-optimizer v0.0.6

22 Sep 08:28
8ef27c3
Compare
Choose a tag to compare
  • Implement Sharpness-Aware Minimization (SAM) optimizer
    • Support Adaptive SAM

pytorch-optimizer v0.0.5

22 Sep 07:42
3c7a89f
Compare
Choose a tag to compare
  • Combine AdaBoundW into AdaBound optimizer with weight_decouple parameter.
  • Implement AdaBelief optimizer
    • Support fp16
    • Support weight_decouple with AdamW scheme
    • Support rectified update similar to RAdam

pytorch-optimizer v0.0.4

22 Sep 06:59
278c29e
Compare
Choose a tag to compare
Implement AdaBound/AdaBoundW optimizers