Skip to content

Commit

Permalink
17 add nt v2 models (#18)
Browse files Browse the repository at this point in the history 
* feat: Update self attention ,multihead and rotary embedding modules

* feat: Update self attention ,multihead and rotary embedding modules

* feat: Update self attention ,multihead and rotary embedding modules

* feat: Update self attention ,multihead and rotary embedding modules

* feat: Tested that the embeddings are consistent across the different repositories

* feat: rename some functions
  • Loading branch information
@dallatt
dallatt authored Sep 15, 2023
1 parent 9fcf2c7 commit 50044a8
Show file tree
Hide file tree
Showing 4 changed files with 442 additions and 65 deletions.
Loading

0 comments on commit 50044a8

Please sign in to comment.