support transfer llama hf weight to megatron weight#246

Open

uygnef wants to merge 10 commits intodeepspeedai:mainfrom uygnef:fy/hf2megatron

+676-23

Commits on Sep 12, 2023

[feature]add weight transfer script for llama2
fengyu05
committed
[feature]add weight transfer script for llama2
fengyu05
committed

Commits on Sep 13, 2023

add llama transfer script
fengyu05
committed
[feature]add weight transfer script for llama2
fengyu05
committed
add readme
fengyu05
committed
Merge branch 'fy/hf2megatron' of github.com:uygnef/Megatron-DeepSpeed into fy/hf2megatron
fengyu05
committed

Commits on Sep 14, 2023

reformat llama transfer script, retrieve model info from LlamaConfig
fengyu05
committed

Commits on Sep 20, 2023

Merge branch 'main' into fy/hf2megatron
uygnef
authored

Commits on Oct 11, 2023

Merge branch 'microsoft:main' into fy/hf2megatron
uygnef
authored

Commits on Oct 12, 2023

add Convert DeepSpeed to Huggingface transformers version script
fengyu05
committed