root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/python/tabby-loadtest/README.md

246 B
Raw Blame History

Run loadtest with tabby on modal GPUs

Steps:

  1. Adjust TABBY_API_HOST in run.sh to match your modal deployment url.
  2. Add models you're interested in to benchmark at end of run.sh
  3. Run run.sh, output will be appended to record.csv