Popular repositories Loading

1. llama-moe llama-moe Public

   ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

   Python 883 46

2. llama llama Public

   Forked from meta-llama/llama

   Inference code for LLaMA models

   Python 1

3. DeepSpeed DeepSpeed Public

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

4. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from microsoft/Megatron-DeepSpeed

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python

5. opencompass-Huawei opencompass-Huawei Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.

   Python

6. NeMo NeMo Public

   Forked from mwiacx/NeMo

   A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

   Python