tabby

History

Meng Zhang e6bf16711f Fix misc mistakes (#13 ) * Fix misc * Fix docker-compose		2023-03-25 21:37:38 +08:00
..
config	Add tabby.tools.repository.updater for easier git repository synchronization. (#9 )	2023-03-25 14:44:46 +08:00
scripts	use TabbyML/NeoX-70M for minimal e2e deployment (#10 )	2023-03-25 17:39:40 +08:00
.gitignore	Remove tokenizer in testdata/	2023-03-24 09:53:48 +08:00
README.md	…
docker-compose.dev.yml	use TabbyML/NeoX-70M for minimal e2e deployment (#10 )	2023-03-25 17:39:40 +08:00
docker-compose.triton.yml	Fix misc mistakes (#13 )	2023-03-25 21:37:38 +08:00
docker-compose.yml	Fix misc mistakes (#13 )	2023-03-25 21:37:38 +08:00

README.md

Deployment

Start service
```
docker-compose up
```

Test API endpoint with curl

curl -X POST http://localhost:5000/v1/completions -H 'Content-Type: application/json' --data '{
    "prompt": "def binarySearch(arr, left, right, x):\n    mid = (left +"
}'