minor fix to gpu serving command (#205)

support-stop-sequences
vodkaslime 2023-06-06 11:26:01 +08:00 committed by GitHub
parent fb60a3f3d6
commit 6f6874d56d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions

View File

@ -22,7 +22,7 @@ tabby --help
tabby serve --model TabbyML/J-350M
# Serve with cuda
tabby-gpu --model TabbyML/J-350M --device cuda
tabby-gpu serve --model TabbyML/J-350M --device cuda
```
## Configuration