Add seq parallelism for attention and MoE MLP#1328
Open
suexu1025 wants to merge 40 commits intomainfrom qinwen/sharding_merge_main
+836-64
Commits
Commits on Feb 27, 2025
- committed
- committed
- committed
Commits on Feb 28, 2025
- committed
- committed
- committed
- committed
Commits on Mar 1, 2025
- committed
Commits on Mar 3, 2025
Commits on Mar 4, 2025
Commits on Mar 5, 2025
- committed
- committed
- committed
- committed
Commits on Mar 6, 2025
Commits on Mar 7, 2025
- committed
- authored
- authored
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed