tabby/deployment

Prerequisites

You need install following dependencies

• docker >= 17.06
• An NVIDIA GPU with enough VRAM to run the model you want.
• NVIDIA Docker Driver

Setup

docker-compose up

Open Admin Panel http://localhost:8501