tabby/development
Meng Zhang 490a1e154d Cleanup development settings 2023-03-28 20:28:20 +08:00
..
config Add gptj converter (#19) 2023-03-27 11:12:52 +08:00
scripts Improve documentations. (#20) 2023-03-27 11:46:18 +08:00
.gitignore Add gptj converter (#19) 2023-03-27 11:12:52 +08:00
Makefile Cleanup development settings 2023-03-28 20:28:20 +08:00
README.md Add gptj converter (#19) 2023-03-27 11:12:52 +08:00
docker-compose.dev.yml Cleanup development settings 2023-03-28 20:28:20 +08:00
docker-compose.python.yml Cleanup development settings 2023-03-28 20:28:20 +08:00
docker-compose.triton.yml Cleanup development settings 2023-03-28 20:28:20 +08:00

README.md

Deployment

  1. Start service
    docker-compose up
    
  2. Test API endpoint with curl
    curl -X POST http://localhost:5000/v1/completions -H 'Content-Type: application/json' --data '{
        "prompt": "def binarySearch(arr, left, right, x):\n    mid = (left +"
    }'