Update README.md

add-more-languages
Meng Zhang 2023-03-30 06:16:05 +08:00 committed by GitHub
parent be4eff7fbf
commit bfcdfd5b7e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 2 deletions

View File

@ -34,8 +34,9 @@ docker run \
-v ./data/hf_cache:/root/.cache/huggingface \
-p 5000:5000 \
-p 8501:8501 \
-p 8080:8080\
-e MODEL_NAME=TabbyML/J-350M tabbyml/tabby
-p 8080:8080 \
-e MODEL_NAME=TabbyML/J-350M \
tabbyml/tabby
```
You can then query the server using `/v1/completions` endpoint: