Skip to content

@pjlab-sys4nlp pjlab-sys4nlp

Change the repository type filter

All

    Repositories list

    7 repositories

    • llama-moe

      Public
      ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
      moellamamixture-of-expertsllmcontinual-pre-trainingexpert-partition
      Python
      •
      Apache License 2.0
      •49•907•4•1•Updated Dec 6, 2024Dec 6, 2024

    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      •
      Apache License 2.0
      •4.2k•0•0•2•Updated Nov 12, 2024Nov 12, 2024

    • NeMo

      Public
      A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
      Python
      •
      Apache License 2.0
      •2.6k•0•0•0•Updated Aug 2, 2024Aug 2, 2024

    • NeMo-Framework-Launcher

      Public
      NeMo Megatron launcher and tools
      Python
      •
      Apache License 2.0
      •140•0•0•0•Updated Aug 2, 2024Aug 2, 2024

    • opencompass-Huawei

      Public
      OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.
      Python
      •
      Apache License 2.0
      •468•0•0•1•Updated Nov 3, 2023Nov 3, 2023

    • Megatron-DeepSpeed

      Public
      Ongoing research training transformer language models at scale, including: BERT & GPT-2
      Python
      •
      Other
      •2.5k•0•0•1•Updated Oct 13, 2023Oct 13, 2023

    • llama

      Public
      Inference code for LLaMA models
      Python
      •
      GNU General Public License v3.0
      •9.6k•1•0•0•Updated Apr 15, 2023Apr 15, 2023