v0.2.3

fedebotu released this 19 Sep 10:22

· 776 commits to main since this release

7ac2091

Add FlashAttention2 support ⚡

Add FlashAttention2 support as mentioned here
Remove old wrapper for half() precision since Lightning already deals with this
Fix scaled_dot_product_attention implementation in PyTorch < 2.0
Minor fixes

Assets 2