root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
tabby/deployment-next
History
Meng Zhang 1c3ec20f93
Prepare public release with a minimal deployment setup (#16) 
* Move deployment to deployment-next

* Add deployment setup

* Update deployment-next

* Remove vector label

* update README.md
 		2023-03-26 22:44:15 +08:00
..
config Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
scripts Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
.gitignore Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
Makefile Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
README.md Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
docker-compose.dev.yml Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
docker-compose.triton.yml Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00
docker-compose.yml Prepare public release with a minimal deployment setup (#16) 2023-03-26 22:44:15 +08:00

README.md

Deployment

  1. Start service 
    docker-compose up
  2. Test API endpoint with curl 
    curl -X POST http://localhost:5000/v1/completions -H 'Content-Type: application/json' --data '{
    "prompt": "def binarySearch(arr, left, right, x):\n    mid = (left +"
}'