Spectral Weight Decay
- Add
SpectralWeightDecay
optimizer wrapper combining - Decouple Weight Decay https://arxiv.org/abs/1711.05101
- Spectral Regularization https://arxiv.org/abs/1705.10941
- Change
sparse_update
ofWeightDecay
to default False - Remove
split
mechanism of spectral norm - Add
lipschitz
option for spectral norm