Skip to content

Spectral Weight Decay

Compare
Choose a tag to compare
@noobOriented noobOriented released this 11 Nov 07:44
· 5 commits to master since this release
b88c9b0
  1. Add SpectralWeightDecay optimizer wrapper combining
  2. Decouple Weight Decay https://arxiv.org/abs/1711.05101
  3. Spectral Regularization https://arxiv.org/abs/1705.10941
  4. Change sparse_update of WeightDecay to default False
  5. Remove split mechanism of spectral norm
  6. Add lipschitz option for spectral norm