tabby/website/docs/installation/apple.md

22 lines
772 B
Markdown
Raw Normal View History

---
sidebar_position: 3
---
# Homebrew (Apple M1/M2)
This guide explains how to install Tabby using homebrew.
Thanks to Apple's Accelerate and CoreML frameworks, we can now run Tabby on edge devices with reasonable inference speed. Follow the steps below to set it up using homebrew:
2023-06-07 02:34:36 +00:00
2023-06-07 02:54:50 +00:00
```bash
brew tap TabbyML/tabby
brew install tabby
# Use the flag --HEAD if you're instered in the nightly build.
brew install --HEAD tabby
2023-06-07 02:53:40 +00:00
# Start server with CodeLlama
tabby serve --device metal --model TabbyML/CodeLlama-7B
```
2023-06-07 02:53:40 +00:00
The compute power of M1/M2 is limited and is likely to be sufficient only for individual usage. If you require a shared instance for a team, we recommend considering Docker hosting with CUDA. You can find more information about Docker [here](./docker).