root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

docs: recommend StarCoder-1B for Apple M1/M2

release-0.2
Meng Zhang 2023-09-17 17:40:22 +08:00
parent 0b4206e6f8
commit ac057f8a2f
1 changed files with 2 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
website/docs/installation/apple.md
View File

@ -11,11 +11,8 @@ Thanks to Apple's Accelerate and CoreML frameworks, we can now run Tabby on edge
brew tap TabbyML/tabby brew tap TabbyML/tabby
brew install tabby brew install tabby
# Use the flag --HEAD if you're instered in the nightly build. # Start server with StarCoder-1B
brew install --HEAD tabby tabby serve --device metal --model TabbyML/StarCoder-1B
# Start server with CodeLlama
tabby serve --device metal --model TabbyML/CodeLlama-7B
``` ```
The compute power of M1/M2 is limited and is likely to be sufficient only for individual usage. If you require a shared instance for a team, we recommend considering Docker hosting with CUDA. You can find more information about Docker [here](./docker). The compute power of M1/M2 is limited and is likely to be sufficient only for individual usage. If you require a shared instance for a team, we recommend considering Docker hosting with CUDA. You can find more information about Docker [here](./docker).