Commit Graph

700 Commits (5be9a6ae1be97d2f675184874d7b1e37beaf81c9)

Author SHA1 Message Date
Zhiming Ma 5be9a6ae1b
docs(clients): update getting-started and troubleshooting docs. (#531) 2023-10-10 21:11:54 -07:00
Zhiming Ma fceb8c9217
feat(intellij): add option to specify node binary; improve docs. (#529) 2023-10-10 08:00:56 -07:00
Meng Zhang 6dbb712918 Release 0.3.0-dev
ctranslate2-bindings@0.3.0-dev
http-api-bindings@0.3.0-dev
llama-cpp-bindings@0.3.0-dev
tabby@0.3.0-dev
tabby-common@0.3.0-dev
tabby-download@0.3.0-dev
tabby-inference@0.3.0-dev
tabby-scheduler@0.3.0-dev

Generated by cargo-workspaces
2023-10-09 19:39:27 -07:00
Meng Zhang d7a8f50de8 fix: use spawn_blocking for sub task without await 2023-10-09 19:38:28 -07:00
Meng Zhang d21a4de79c
chore: set max timeout for /v1/completions handler (#526)
* chore: set max timeout for /v1/completions handler

* refactor: extract sub routers

* fix
2023-10-09 18:44:55 -07:00
Meng Zhang 24eadf0de8
refactor: make /v1/health accept GET requests (#527) 2023-10-09 18:34:56 +00:00
Meng Zhang 3eb5f4132c chore: add 'v*' match pattern to restrict git describe only compare against a actual release 2023-10-09 11:13:37 -07:00
Meng Zhang 0f8ee7f589
refactor: move http engine creation to its sub crates (#524) 2023-10-09 17:37:04 +00:00
Meng Zhang 41e48dc119
docs: Update vscode walthrough on tabby cloud (#507) 2023-10-08 21:26:21 -07:00
Meng Zhang 76c2cd25a4
docs: add information on what data are collected for tabby server (#520) 2023-10-07 11:32:21 -07:00
Meng Zhang 8c09f75360
refactor: extract language related data into languages.rs (#518)
* refactor: extract language related data into languages.rs

* fix

* cleanup index

* fix

* further sanitize

* add a score threshold
2023-10-07 01:40:21 +00:00
Meng Zhang d85a7892d1
feat: connect prompt rewriting part (#517)
* feat: enable /v1beta/search if index is available

* make prompt rewriting work

* update

* fix test

* fix api doc
2023-10-07 00:29:24 +00:00
Meng Zhang 8497fb1372
feat: implement /v1beta/search interface (#516)
* feat: implement /v1beta/search interface

* update

* update

* improve debugger
2023-10-06 18:54:12 +00:00
Meng Zhang fd2a1ab865
fix: switch back to regex based implementation for stop words (#513) 2023-10-06 09:04:37 +00:00
Meng Zhang 4c00ac06fb
fix(download): mark ggml model downloading should be optional, as ggml is only used for metal backend for now (#512) 2023-10-05 16:54:56 +00:00
Meng Zhang 9cd2accbaa
feat: adjust code indexing logic (#510) 2023-10-05 05:29:41 +00:00
Meng Zhang 1babc38902
feat: add datset viewer, remove treesitter languages that hasn't been verified (#509)
* refactor: remove not verified tree sitter queries

* feat(experimental): add dataset viewer

update
2023-10-04 21:49:42 -07:00
Meng Zhang 55f68d4224
test: unit test for indexing job (#508)
* test: unit test for indexing job

* update

* reduce test fixture length
2023-10-04 23:27:19 +00:00
Meng Zhang e0b2a775d8 docs: add m1/m2 support status to chat model in model directory 2023-10-04 15:04:45 -07:00
Meng Zhang 6b38b32117 docs: add chat_template to model spec 2023-10-04 15:04:45 -07:00
Meng Zhang f7ebce2514
refactor: deprecate --compute-type (#505) 2023-10-04 18:45:34 +00:00
Meng Zhang b16aeaebc0 docs: add HuggingFace link on spaces tutorial 2023-10-04 08:45:57 -07:00
Meng Zhang 93b6766fca
docs: Update MODEL_SPEC.md (#504)
Fix #503
2023-10-04 08:33:51 -07:00
Meng Zhang f44e87ff0e
docs(fix): broken links in model directory 2023-10-03 22:28:07 -07:00
Meng Zhang 0a949aa6b6
docs: add modelscope registry information to model directory 2023-10-03 22:23:47 -07:00
Meng Zhang 3600d9e399 chore: update sync.sh models 2023-10-03 20:28:58 -07:00
Meng Zhang e881008112
docs: remove WizardCoder-15B from model directory 2023-10-03 20:27:51 -07:00
Meng Zhang 1d364fd628 feat: add sync.sh for copy-to-modelscope 2023-10-03 20:03:13 -07:00
Meng Zhang 8a03c9bf17 refactor: use / as server url
Swagger access to the page, regardless of host / port, will just work.
2023-10-03 18:33:56 -07:00
Meng Zhang 5a6fa6defd
docs: Update CHANGELOG.md 2023-10-03 17:37:11 -07:00
Meng Zhang 2d5b3e4ff5 chore: release v0.2.1 2023-10-03 17:13:39 -07:00
Meng Zhang 503c44e7c5 fix: playground environment misconfig 2023-10-03 17:10:02 -07:00
Meng Zhang b3b498624c feat: deprecate num_replicas_per_thread, generate default value for it 2023-10-03 17:02:37 -07:00
Meng Zhang 1afba47059 feat: allow set num_replicas_per_device for CUDA to increase throughput 2023-10-03 15:52:25 -07:00
Meng Zhang 375675c6b4
docs: Update CHANGELOG.md 2023-10-03 13:44:17 -07:00
Meng Zhang ceaa7ab012 chore: update main branch to v0.3.0-dev 2023-10-03 13:38:27 -07:00
Meng Zhang 1731c3075e chore: Update version to 0.2.0 2023-10-03 13:32:21 -07:00
Meng Zhang b6ccf3df66 docs: update changelog for v0.2.0 2023-10-03 13:32:21 -07:00
Meng Zhang 6ad99cb23d
docs: update documentation to prepare for 0.2 release (#502)
* docs: fix installation emoji

* docs: set StarCoder-1B to be default model for docker install

* docs: add `--chat-model` in model directory
2023-10-03 13:11:07 -07:00
Meng Zhang 0e5128e8fb feat: add chat_template field in tabby.json 2023-10-03 11:46:05 -07:00
Meng Zhang 7fc76228f7 chore: add debug log for /chat interface 2023-10-03 11:38:58 -07:00
Meng Zhang 692c2fe0fd Release 0.2.0-rc.0
ctranslate2-bindings@0.2.0-rc.0
http-api-bindings@0.2.0-rc.0
llama-cpp-bindings@0.2.0-rc.0
tabby@0.2.0-rc.0
tabby-common@0.2.0-rc.0
tabby-download@0.2.0-rc.0
tabby-inference@0.2.0-rc.0
tabby-scheduler@0.2.0-rc.0

Generated by cargo-workspaces
2023-10-02 19:14:12 -07:00
Meng Zhang 6306bb3f01
fix: if local file doens't exist, local_cache_key should be cleared (#501)
* fix: if local file doens't exist, local_cache_key should be cleared

* fix
2023-10-02 23:48:35 +00:00
Meng Zhang ce20bd6154
refactor: use RegexSet for cleaer stop regex construction (#499)
* fix: add a regression test cased for stop words regex matching

* refactor: use RegexSet for cleaer stop regex construction
2023-10-02 23:21:51 +00:00
Meng Zhang 63612d5a67
fix(tabby-download): even when prefer_local_file is set to true, we should still check for remote (if network is avaialble), to see if a file should be upgraded (#500) 2023-10-02 23:09:57 +00:00
Meng Zhang 80a17aea37
feat: only show /v1/chat api if --chat-model is set (#498) 2023-10-02 17:17:27 +00:00
Meng Zhang f05dd3a2f6
refactor: cleanup chat api make it message oriented (#497)
* refactor: refactor into /chat/completions api

* Revert "feat: support request level stop words (#492)"

This reverts commit 0d6840e372.

* feat: adjust interface

* switch interface in tabby-playground

* move to chat/prompt, add unit test

* update interface
2023-10-02 15:39:15 +00:00
Meng Zhang dfdd0373a6 fix: when llama model loads failed, panic in rust stack 2023-10-01 22:25:25 -07:00
Meng Zhang 1fd3adbe0c
docs: add a snippet explaining the streaming example 2023-09-30 18:05:12 -07:00
Meng Zhang f7ecab5bca
docs: change `consumer` to `client` 2023-09-30 17:42:24 -07:00