Update README.md
parent
bf7d149a27
commit
44ac6cd510
|
|
@ -44,7 +44,7 @@ curl -X POST http://localhost:5000/v1/completions -H 'Content-Type: application/
|
||||||
}'
|
}'
|
||||||
```
|
```
|
||||||
|
|
||||||
To use the GPU backend (triton) for a faster inference experience, use `deployment/docker-compose.yml`:
|
To use the GPU backend (triton) for a faster inference speed, use `deployment/docker-compose.yml`:
|
||||||
```bash
|
```bash
|
||||||
docker-compose up
|
docker-compose up
|
||||||
```
|
```
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue