代码库

The hub for EleutherAI's work on interpretability and learning dynamics
Jupyter Notebook
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Python
deepspeed-librarygpt-3language-modeltransformers
A framework for few-shot evaluation of language models.
Python
evaluation-frameworklanguage-modeltransformer