root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

fix: model replica not working for skypilot

add-more-languages
Meng Zhang 2023-04-02 20:55:35 +08:00
parent 97f3c439c6
commit 6e0ab3af49
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
deployment/skypilot/default.yml
View File

@ -16,7 +16,10 @@ setup: |
# On certain cloud providers (e.g lambda cloud), the default user is not added to docker group, so we need sudo here # On certain cloud providers (e.g lambda cloud), the default user is not added to docker group, so we need sudo here
sudo docker-compose pull sudo docker-compose pull
# Add current user to docker group, it won't take effect immediately as skypilot job is started by a long-running daemon.
sudo usermod -aG docker $USER
run: | run: |
cd tabby/deployment cd tabby/deployment
MODEL_REPLICA=${MODEL_REPLICA:-8} sudo docker-compose up sudo MODEL_REPLICA=${MODEL_REPLICA:-8} docker-compose up