Update README.md
Browse files
README.md
CHANGED
|
@@ -166,6 +166,7 @@ Accuracy-norm score*
|
|
| 166 |
| Infery LLM | 2,029.6 |
|
| 167 |
|
| 168 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
|
|
|
| 169 |
|
| 170 |
## Disclaimer
|
| 171 |
|
|
|
|
| 166 |
| Infery LLM | 2,029.6 |
|
| 167 |
|
| 168 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
| 169 |
+
- In order to replicate the results of the PyTorch benchmark, use this [code example](https://huggingface.co/Deci/DeciLM-6b-instruct/blob/main/hf_benchmark_example.py)
|
| 170 |
|
| 171 |
## Disclaimer
|
| 172 |
|