diff --git a/README.md b/README.md index 1170cce..d643d0f 100644 --- a/README.md +++ b/README.md @@ -34,8 +34,9 @@ docker run \ -v ./data/hf_cache:/root/.cache/huggingface \ -p 5000:5000 \ -p 8501:8501 \ - -p 8080:8080\ - -e MODEL_NAME=TabbyML/J-350M tabbyml/tabby + -p 8080:8080 \ + -e MODEL_NAME=TabbyML/J-350M \ + tabbyml/tabby ``` You can then query the server using `/v1/completions` endpoint: