tabby/docs/deployment.md

Prerequisites

You need install following dependencies

• docker >= 17.06
• An NVIDIA GPU with enough VRAM to run the model you want.
• NVIDIA Docker Driver

Setup Tabby Server with docker-compose.

1. Goto deployment directory
2. Execute docker-compose up.

Tabby Client

There're several ways to talk to the Tabby Server.

Tabby Admin Panel http://localhost:8501

OpenAPI http://localhost:5000