Skip to content

Commit

Permalink
add output path and hf token
Browse files Browse the repository at this point in the history
  • Loading branch information
anandhu-eng committed Jan 7, 2025
1 parent bdb59a5 commit 3c3bd45
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/benchmarks/language/get-llama3_1-405b-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,14 +13,14 @@ The benchmark implementation run command will automatically download the validat

### Get Validation Dataset
```
cm run script --tags=get,dataset,mlperf,inference,llama3,_validation -j
cm run script --tags=get,dataset,mlperf,inference,llama3,_validation --outdirname=<path to download> -j
```

=== "Calibration"

### Get Calibration Dataset
```
cm run script --tags=get,dataset,mlperf,inference,llama3,_calibration -j
cm run script --tags=get,dataset,mlperf,inference,llama3,_calibration --outdirname=<path to download> -j
```

## Model
Expand All @@ -32,10 +32,10 @@ Get the Official MLPerf LLAMA3.1-405b Model

### Pytorch
```
cm run script --tags=get,ml-model,llama3 -j
cm run script --tags=get,ml-model,llama3 --outdirname=<path to download> --hf_token=<huggingface access token> -j
```

!!! tip

Downloading llama3_1-405B model from Hugging Face will prompt you to enter the Hugging Face username and password. Please note that the password required is the [**access token**](https://huggingface.co/settings/tokens) generated for your account. Additionally, ensure that your account has access to the [llama3-405B](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct) model.
Downloading llama3_1-405B model from Hugging Face will require an [**access token**](https://huggingface.co/settings/tokens) which could be generated for your account. Additionally, ensure that your account has access to the [llama3-405B](https://huggingface.co/meta-llama/Llama-3.1-405B-Instruct) model.

0 comments on commit 3c3bd45

Please sign in to comment.