Commit Graph

3 Commits (b622bd6762a3ee1d87608ca6bcf4005e40c1ae49)

Author SHA1 Message Date
Meng Zhang b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment (#10)
* use TabbyML/NeoX-70M for minimal e2e deployment

* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang 0f5a959269 Remove tokenizer in testdata/ 2023-03-24 09:53:48 +08:00
Meng Zhang a0b438da06
Add python transformer backend for tabby (mainly used for local dev / test in non-cuda environment) (#6)
* Add python backend

* Split docker-compose.triton.yml

* update makefile
2023-03-23 14:14:33 +08:00