Commit Graph

6 Commits (0acc9756187b15f89c776acdf581f4dc5fb8e184)

Author SHA1 Message Date
Meng Zhang 93e4f5b3ca refactor: default docker-compose w/ python backend 2023-04-06 00:50:24 +08:00
Meng Zhang 1c3ec20f93
Prepare public release with a minimal deployment setup (#16)
* Move deployment to deployment-next

* Add deployment setup

* Update deployment-next

* Remove vector label

* update README.md
2023-03-26 22:44:15 +08:00
Meng Zhang e6bf16711f
Fix misc mistakes (#13)
* Fix misc

* Fix docker-compose
2023-03-25 21:37:38 +08:00
Meng Zhang b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment (#10)
* use TabbyML/NeoX-70M for minimal e2e deployment

* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang 0f5a959269 Remove tokenizer in testdata/ 2023-03-24 09:53:48 +08:00
Meng Zhang a0b438da06
Add python transformer backend for tabby (mainly used for local dev / test in non-cuda environment) (#6)
* Add python backend

* Split docker-compose.triton.yml

* update makefile
2023-03-23 14:14:33 +08:00