From bfcdfd5b7ed8b6e01a889455b8b0648c22320af9 Mon Sep 17 00:00:00 2001 From: Meng Zhang Date: Thu, 30 Mar 2023 06:16:05 +0800 Subject: [PATCH] Update README.md --- README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 1170cce..d643d0f 100644 --- a/README.md +++ b/README.md @@ -34,8 +34,9 @@ docker run \ -v ./data/hf_cache:/root/.cache/huggingface \ -p 5000:5000 \ -p 8501:8501 \ - -p 8080:8080\ - -e MODEL_NAME=TabbyML/J-350M tabbyml/tabby + -p 8080:8080 \ + -e MODEL_NAME=TabbyML/J-350M \ + tabbyml/tabby ``` You can then query the server using `/v1/completions` endpoint: