From ac057f8a2ff56bbc17e33735aaa672c832443950 Mon Sep 17 00:00:00 2001 From: Meng Zhang Date: Sun, 17 Sep 2023 17:40:22 +0800 Subject: [PATCH] docs: recommend StarCoder-1B for Apple M1/M2 --- website/docs/installation/apple.md | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-) diff --git a/website/docs/installation/apple.md b/website/docs/installation/apple.md index 435f70b..4cbf178 100644 --- a/website/docs/installation/apple.md +++ b/website/docs/installation/apple.md @@ -11,11 +11,8 @@ Thanks to Apple's Accelerate and CoreML frameworks, we can now run Tabby on edge brew tap TabbyML/tabby brew install tabby -# Use the flag --HEAD if you're instered in the nightly build. -brew install --HEAD tabby - -# Start server with CodeLlama -tabby serve --device metal --model TabbyML/CodeLlama-7B +# Start server with StarCoder-1B +tabby serve --device metal --model TabbyML/StarCoder-1B ``` The compute power of M1/M2 is limited and is likely to be sufficient only for individual usage. If you require a shared instance for a team, we recommend considering Docker hosting with CUDA. You can find more information about Docker [here](./docker).