Commit Graph

3 Commits (ea9f3f8f94b364add0e22a5959bbbcb6445b5059)

Author SHA1 Message Date
Meng Zhang b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment (#10)
* use TabbyML/NeoX-70M for minimal e2e deployment

* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang 0f5a959269 Remove tokenizer in testdata/ 2023-03-24 09:53:48 +08:00
Meng Zhang a0b438da06
Add python transformer backend for tabby (mainly used for local dev / test in non-cuda environment) (#6)
* Add python backend

* Split docker-compose.triton.yml

* update makefile
2023-03-23 14:14:33 +08:00