Zhiming Ma
5be9a6ae1b
docs(clients): update getting-started and troubleshooting docs. ( #531 )
2023-10-10 21:11:54 -07:00
Zhiming Ma
fceb8c9217
feat(intellij): add option to specify node binary; improve docs. ( #529 )
2023-10-10 08:00:56 -07:00
Meng Zhang
6dbb712918
Release 0.3.0-dev
...
ctranslate2-bindings@0.3.0-dev
http-api-bindings@0.3.0-dev
llama-cpp-bindings@0.3.0-dev
tabby@0.3.0-dev
tabby-common@0.3.0-dev
tabby-download@0.3.0-dev
tabby-inference@0.3.0-dev
tabby-scheduler@0.3.0-dev
Generated by cargo-workspaces
2023-10-09 19:39:27 -07:00
Meng Zhang
d7a8f50de8
fix: use spawn_blocking for sub task without await
2023-10-09 19:38:28 -07:00
Meng Zhang
d21a4de79c
chore: set max timeout for /v1/completions handler ( #526 )
...
* chore: set max timeout for /v1/completions handler
* refactor: extract sub routers
* fix
2023-10-09 18:44:55 -07:00
Meng Zhang
24eadf0de8
refactor: make /v1/health accept GET requests ( #527 )
2023-10-09 18:34:56 +00:00
Meng Zhang
3eb5f4132c
chore: add 'v*' match pattern to restrict git describe only compare against a actual release
2023-10-09 11:13:37 -07:00
Meng Zhang
0f8ee7f589
refactor: move http engine creation to its sub crates ( #524 )
2023-10-09 17:37:04 +00:00
Meng Zhang
41e48dc119
docs: Update vscode walthrough on tabby cloud ( #507 )
2023-10-08 21:26:21 -07:00
Meng Zhang
76c2cd25a4
docs: add information on what data are collected for tabby server ( #520 )
2023-10-07 11:32:21 -07:00
Meng Zhang
8c09f75360
refactor: extract language related data into languages.rs ( #518 )
...
* refactor: extract language related data into languages.rs
* fix
* cleanup index
* fix
* further sanitize
* add a score threshold
2023-10-07 01:40:21 +00:00
Meng Zhang
d85a7892d1
feat: connect prompt rewriting part ( #517 )
...
* feat: enable /v1beta/search if index is available
* make prompt rewriting work
* update
* fix test
* fix api doc
2023-10-07 00:29:24 +00:00
Meng Zhang
8497fb1372
feat: implement /v1beta/search interface ( #516 )
...
* feat: implement /v1beta/search interface
* update
* update
* improve debugger
2023-10-06 18:54:12 +00:00
Meng Zhang
fd2a1ab865
fix: switch back to regex based implementation for stop words ( #513 )
2023-10-06 09:04:37 +00:00
Meng Zhang
4c00ac06fb
fix(download): mark ggml model downloading should be optional, as ggml is only used for metal backend for now ( #512 )
2023-10-05 16:54:56 +00:00
Meng Zhang
9cd2accbaa
feat: adjust code indexing logic ( #510 )
2023-10-05 05:29:41 +00:00
Meng Zhang
1babc38902
feat: add datset viewer, remove treesitter languages that hasn't been verified ( #509 )
...
* refactor: remove not verified tree sitter queries
* feat(experimental): add dataset viewer
update
2023-10-04 21:49:42 -07:00
Meng Zhang
55f68d4224
test: unit test for indexing job ( #508 )
...
* test: unit test for indexing job
* update
* reduce test fixture length
2023-10-04 23:27:19 +00:00
Meng Zhang
e0b2a775d8
docs: add m1/m2 support status to chat model in model directory
2023-10-04 15:04:45 -07:00
Meng Zhang
6b38b32117
docs: add chat_template to model spec
2023-10-04 15:04:45 -07:00
Meng Zhang
f7ebce2514
refactor: deprecate --compute-type ( #505 )
2023-10-04 18:45:34 +00:00
Meng Zhang
b16aeaebc0
docs: add HuggingFace link on spaces tutorial
2023-10-04 08:45:57 -07:00
Meng Zhang
93b6766fca
docs: Update MODEL_SPEC.md ( #504 )
...
Fix #503
2023-10-04 08:33:51 -07:00
Meng Zhang
f44e87ff0e
docs(fix): broken links in model directory
2023-10-03 22:28:07 -07:00
Meng Zhang
0a949aa6b6
docs: add modelscope registry information to model directory
2023-10-03 22:23:47 -07:00
Meng Zhang
3600d9e399
chore: update sync.sh models
2023-10-03 20:28:58 -07:00
Meng Zhang
e881008112
docs: remove WizardCoder-15B from model directory
2023-10-03 20:27:51 -07:00
Meng Zhang
1d364fd628
feat: add sync.sh for copy-to-modelscope
2023-10-03 20:03:13 -07:00
Meng Zhang
8a03c9bf17
refactor: use / as server url
...
Swagger access to the page, regardless of host / port, will just work.
2023-10-03 18:33:56 -07:00
Meng Zhang
5a6fa6defd
docs: Update CHANGELOG.md
2023-10-03 17:37:11 -07:00
Meng Zhang
2d5b3e4ff5
chore: release v0.2.1
2023-10-03 17:13:39 -07:00
Meng Zhang
503c44e7c5
fix: playground environment misconfig
2023-10-03 17:10:02 -07:00
Meng Zhang
b3b498624c
feat: deprecate num_replicas_per_thread, generate default value for it
2023-10-03 17:02:37 -07:00
Meng Zhang
1afba47059
feat: allow set num_replicas_per_device for CUDA to increase throughput
2023-10-03 15:52:25 -07:00
Meng Zhang
375675c6b4
docs: Update CHANGELOG.md
2023-10-03 13:44:17 -07:00
Meng Zhang
ceaa7ab012
chore: update main branch to v0.3.0-dev
2023-10-03 13:38:27 -07:00
Meng Zhang
1731c3075e
chore: Update version to 0.2.0
2023-10-03 13:32:21 -07:00
Meng Zhang
b6ccf3df66
docs: update changelog for v0.2.0
2023-10-03 13:32:21 -07:00
Meng Zhang
6ad99cb23d
docs: update documentation to prepare for 0.2 release ( #502 )
...
* docs: fix installation emoji
* docs: set StarCoder-1B to be default model for docker install
* docs: add `--chat-model` in model directory
2023-10-03 13:11:07 -07:00
Meng Zhang
0e5128e8fb
feat: add chat_template field in tabby.json
2023-10-03 11:46:05 -07:00
Meng Zhang
7fc76228f7
chore: add debug log for /chat interface
2023-10-03 11:38:58 -07:00
Meng Zhang
692c2fe0fd
Release 0.2.0-rc.0
...
ctranslate2-bindings@0.2.0-rc.0
http-api-bindings@0.2.0-rc.0
llama-cpp-bindings@0.2.0-rc.0
tabby@0.2.0-rc.0
tabby-common@0.2.0-rc.0
tabby-download@0.2.0-rc.0
tabby-inference@0.2.0-rc.0
tabby-scheduler@0.2.0-rc.0
Generated by cargo-workspaces
2023-10-02 19:14:12 -07:00
Meng Zhang
6306bb3f01
fix: if local file doens't exist, local_cache_key should be cleared ( #501 )
...
* fix: if local file doens't exist, local_cache_key should be cleared
* fix
2023-10-02 23:48:35 +00:00
Meng Zhang
ce20bd6154
refactor: use RegexSet for cleaer stop regex construction ( #499 )
...
* fix: add a regression test cased for stop words regex matching
* refactor: use RegexSet for cleaer stop regex construction
2023-10-02 23:21:51 +00:00
Meng Zhang
63612d5a67
fix(tabby-download): even when prefer_local_file is set to true, we should still check for remote (if network is avaialble), to see if a file should be upgraded ( #500 )
2023-10-02 23:09:57 +00:00
Meng Zhang
80a17aea37
feat: only show /v1/chat api if --chat-model is set ( #498 )
2023-10-02 17:17:27 +00:00
Meng Zhang
f05dd3a2f6
refactor: cleanup chat api make it message oriented ( #497 )
...
* refactor: refactor into /chat/completions api
* Revert "feat: support request level stop words (#492 )"
This reverts commit 0d6840e372 .
* feat: adjust interface
* switch interface in tabby-playground
* move to chat/prompt, add unit test
* update interface
2023-10-02 15:39:15 +00:00
Meng Zhang
dfdd0373a6
fix: when llama model loads failed, panic in rust stack
2023-10-01 22:25:25 -07:00
Meng Zhang
1fd3adbe0c
docs: add a snippet explaining the streaming example
2023-09-30 18:05:12 -07:00
Meng Zhang
f7ecab5bca
docs: change `consumer` to `client`
2023-09-30 17:42:24 -07:00