| URI | Model Params | Checkpoint file size | Is Default? |
|---|---|---|---|
| EleutherAI/gpt-neo-125m | 125m | 526 MB | ❌ |
| EleutherAI/gpt-neo-1.3B | 1.3B | 5.31 GB | ✅ |
| EleutherAI/gpt-neo-2.7B | 2.7B | 10.7 GB | ❌ |
| EleutherAI/gpt-neox-20b | 20B | 41.3 GB | ❌ |
| URI | Model Params | Checkpoint file size | Is Default? |
|---|---|---|---|
| bigscience/bloom-560m | 560m | 1.12 GB | ✅ |
| bigscience/bloom-1b7/ | 1.7B | 3.4GB | ❌ |
| bigscience/bloom-3b | 3B | 6.01 GB | ❌ |
| bigscience/bloom-7b1 | 7.1B | 14 GB | ❌ |
| URI | Model Params | Checkpoint file size | Is Default? |
|---|---|---|---|
| openlm-research/open_llama_3b_v2 | 3B | 6.85 GB | ✅ |
| openlm-research/open_llama_7b_v2 | 7B | 13 GB | ❌ |
| openlm-research/open_llama_13b | 13B | 26 GB | ❌ |
| URI | Model Params | Checkpoint file size | Is Default? |
|---|---|---|---|
| facebook/opt-125m | 125mm | 250 MB | ❌ |
| facebook/opt-350m | 350m | 622 MB | ✅ |
| facebook/opt-1.3b | 1.3 B | 2.63 GB | ❌ |
| facebook/opt-2.7b | 2.7 B | 5.3 GB | ❌ |
| facebook/opt-6.7b | 2.7 B | 13 GB | ❌ |
| facebook/opt-66b | 66 B | 133 GB | ❌ |