root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/website/docs/installation/apple.md

685 B
Raw Blame History

sidebar_position
3

Homebrew (Apple M1/M2)

This guide explains how to install Tabby using homebrew.

Thanks to Apple's Accelerate and CoreML frameworks, we can now run Tabby on edge devices with reasonable inference speed. Follow the steps below to set it up using homebrew:

brew tap TabbyML/tabby
brew install tabby

# Start server with StarCoder-1B
tabby serve --device metal --model TabbyML/StarCoder-1B

The compute power of M1/M2 is limited and is likely to be sufficient only for individual usage. If you require a shared instance for a team, we recommend considering Docker hosting with CUDA. You can find more information about Docker here.