tabby

History

Meng Zhang 0f5a959269 Remove tokenizer in testdata/		2023-03-24 09:53:48 +08:00
..
config	Create config dir for config files in deployment	2023-03-22 23:58:55 +08:00
.gitignore	Remove tokenizer in testdata/	2023-03-24 09:53:48 +08:00
Dockerfile	Add admin panel (w/ streamlit) and logging (w/ vectordev) (#4 )	2023-03-22 23:18:12 +08:00
README.md	Create README.md	2023-03-22 23:57:26 +08:00
docker-compose.dev.yml	Add admin panel (w/ streamlit) and logging (w/ vectordev) (#4 )	2023-03-22 23:18:12 +08:00
docker-compose.triton.yml	Remove tokenizer in testdata/	2023-03-24 09:53:48 +08:00
docker-compose.yml	Remove tokenizer in testdata/	2023-03-24 09:53:48 +08:00

README.md

Deployment

Start service
```
docker-compose up
```

Test API endpoint with curl

curl -X POST http://localhost:5000/v1/completions -H 'Content-Type: application/json' --data '{
    "prompt": "def binarySearch(arr, left, right, x):\n    mid = (left +"
}'