From 08b860081c3076aa63521aa19f03ba3ec855c3da Mon Sep 17 00:00:00 2001 From: Meng Zhang Date: Mon, 5 Jun 2023 19:42:58 -0700 Subject: [PATCH] docs: update server.md (#204) --- website/docs/server.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/website/docs/server.md b/website/docs/server.md index dbe2b79..f37db26 100644 --- a/website/docs/server.md +++ b/website/docs/server.md @@ -20,6 +20,9 @@ tabby --help # Serve the model tabby serve --model TabbyML/J-350M + +# Serve with cuda +tabby-gpu --model TabbyML/J-350M --device cuda ``` ## Configuration