Releases: Yoctol/talos
Releases · Yoctol/talos
Fix MaskCNN/Pool
Fix the default behavior of MaskCNN, MaskPool
CuDNNRNN
- fix 1.2.2 bugs
- bypass the mask if return_sequences
CuDNNRNN
- Let
add_spectral_norm
supportsCuDNNGRU
andCuDNNLSTM
- fix the mistakes that
CuDNNGRU
andCuDNNLSTM
fed mask fromSequential
Mask Max Pooling
add MaskMaxPool1D
and MaskGlobalMaxPool1D
to masking module
Masking Layer Module
Major Features and Improvements
- Add layers supporting masking:
MaskConv1D
,MaskAveragePooling1D
,ApplyMask
Breaking Changes:
- Rename
GlobalAveragePooling1D
support masking ->MaskGlobalAveragePooling1D
,
move it totalos.layers.masking
OriginalGlobalAveragePooling1D
don't support masking anymore.
Tensorflow 1.13.1
Breaking Change:
- Upgrade tensorflow to 1.13.1
Fix Spectral Norm Formula
Fix spectral norm formula.
Add tests to make sure its gradient has same result as paper.
Model spectral norm
can apply add_spectral_norm on custom Model subclass
Fix transformer res-add
Fix the res-add of inputs of TransformerBlock and TransformerXL
Bidirectional XL
TransformerXL supports gradient & bidirectional