Commit Graph

974 Commits (5cebca4164433455b2b18dfaa79e1e1309ed7eda)

Author SHA1 Message Date
Meng Zhang 36ffeb63f1 refactor: remove useless rust-cxx-cmake-bridge 2023-10-31 17:58:21 -07:00
Meng Zhang 296342efd8
refactor: use llama.cpp tokenizer (#683)
* refactor: switch to llama.cpp tokenizer to simplify implementation

* refactor: remove tokenizer dependency from tabby

* refactor: renaming decoding to stop condition

* refactor: remove tokenizer dependency

* refactor: remove submodule

* chore: update formatting

* move tokenization to c++
2023-10-31 22:16:09 +00:00
Meng Zhang f15926f233 chore(ui): update crates/tabby/ui 2023-10-31 08:51:22 -07:00
Meng Zhang 177689341f
chore(ui): rename runners to workers (#681) 2023-10-30 22:11:01 -07:00
Meng Zhang 3f1f8bfd30 fix: add /swagger to tabby ui handler 2023-10-30 17:36:22 -07:00
Meng Zhang 73758e207d
feat: improve dashboard UI (#677) 2023-10-30 21:47:38 +00:00
Meng Zhang b4772fbcd0
feat(ui): add dashboard (#674)
* feat(ui): add dashboard

* handle path
2023-10-30 07:29:50 +00:00
Meng Zhang 89a63dbf33
fix: when send failed, treat the request as stopped (#673) 2023-10-30 06:27:09 +00:00
Meng Zhang de827b1e74
Revert "feat: make --model optional (#668)" (#672)
This reverts commit c55e4481ba.
2023-10-29 21:44:11 -07:00
Zhiming Ma f991b8b7ab
fix(agent): update config.toml template. (#671) 2023-10-29 21:27:28 -07:00
Zhiming Ma e88097320b
feat(agent): add auth token config. (#649)
* feat(agent): add auth token config.

* fix: fix agent loading auth token.

* fix: update retain old config filepath.

* fix: update retain old config filepath.

* fix: lint.

* fix: remove auto migrate, update config template.
2023-10-29 21:09:18 -07:00
Zhiming Ma c51e00ee45
feat(agent): add experimental option: scope of indentation filter. (#652)
* feat(agent): add experimental option: scope of indentation filter.

* fix: add config to fix unit test for limitScopeByIndentation.
2023-10-29 19:59:09 -07:00
Zhiming Ma 238d81ad4f
feat(agent): add experimental option: strip auto-closing chars in prompt suffix. (#651)
* feat(agent): add experimental option: strip auto-closing chars in prompt suffix.

* fix: rename settings adding experimental prefix.
2023-10-29 19:58:25 -07:00
leiwen83 b47bdd5d77
fix: align with fastchat mainstream (#670)
Fastchat mainstream change its return format, and text now is only
string in choices structure.

So make this change, to work with mainstream fastchat.

Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
2023-10-29 19:31:46 -07:00
Meng Zhang 88d2617a34
fix: move events writer to individual thread (#669) 2023-10-30 01:31:41 +00:00
Meng Zhang c55e4481ba
feat: make --model optional (#668) 2023-10-30 00:04:42 +00:00
Meng Zhang 7330d75de6 chore: clear cache when there's no active requests 2023-10-29 16:30:30 -07:00
Meng Zhang 81ed9d3325
docs: remove boilerplate section 2023-10-29 16:21:53 -07:00
Meng Zhang fcc1deaf99
chore: add section on providing version information in issue template 2023-10-29 16:20:29 -07:00
Meng Zhang cf02c8ac5f fix: update license typo 2023-10-29 16:03:21 -07:00
Meng Zhang afaaa49f21 docs: update LICENSE details 2023-10-29 16:02:53 -07:00
Meng Zhang 0328d055d0
docs: update README.md 2023-10-29 15:59:00 -07:00
Meng Zhang 2ee5dbfd4f
chore: move tabby-ui under ee license. (#667)
* chore: introduce tabby-ui EE license.

* update
2023-10-29 15:56:57 -07:00
Meng Zhang 8c680a73fb
feat(ui): add /api page (#665)
* refactor(tabby-ui): extract tabby-fetcher

* feat(tabby-ui): add /api page

* feat(tabby-ui): add chat model badge

* fix: add components.json for shadcn

* chore: release tabby-ui
2023-10-29 14:55:50 -07:00
Ajay Gonepuri (GONAPCORP) 2833ccfe75
fix(docs): correct typos (#662)
* docs: fix typos

* Update CHANGELOG.md

* Update README.md

* Update README.md

* Update index.md
2023-10-29 02:41:38 -07:00
Meng Zhang 0078db7bff
docs: exclude website/ directory for language statistics 2023-10-29 01:44:48 -07:00
Meng Zhang 680f6b866e
docs: exclude client side code for language statistics 2023-10-29 01:43:51 -07:00
Meng Zhang 3bd7dc8f78
docs: exclude generated javascript code to be used for language statistics 2023-10-29 01:41:58 -07:00
Meng Zhang ff65c59996
docs: Update MODEL_SPEC.md. remove info about ctranslate2 backend (#660) 2023-10-29 01:24:22 -07:00
Meng Zhang 68a7b3628c
docs: Update faq.mdx on multiple GPU utilization 2023-10-29 01:22:13 -07:00
Meng Zhang 7bd99d14c0
feat: support continuous batching in llama.cpp backend (#659)
* refactor: switch back to llama batch interface

* feat: support cont batching
2023-10-28 23:37:05 -07:00
Meng Zhang 14d03b6826 fix(ui): handle invalid semver error 2023-10-28 23:30:35 -07:00
Meng Zhang 8dc5526091 Revert "feat: supports PHP (#634)"
This reverts commit 688e7d75b5.
2023-10-28 23:02:10 -07:00
Meng Zhang 43cc5f38cc feat: do not download ctranslate2 files in downloader 2023-10-28 02:27:09 -07:00
Meng Zhang 444222683a fix(llama.cpp): bump upstream fix for starcoder model on cuda 2023-10-28 02:03:34 -07:00
Meng Zhang 3151d9100b
docs: add labels to docker image. add tag for branch build. 2023-10-28 00:04:16 -07:00
Meng Zhang dadd58573d docs: update logo font weight 2023-10-27 23:56:57 -07:00
Meng Zhang 9309e0314f fix: fix docker build 2023-10-27 21:25:45 -07:00
Meng Zhang 6dd12ce1ec
fix: adding cuda search path to docker build. 2023-10-27 19:40:35 -07:00
Meng Zhang 2d948639be
fix: docker build for llama cuda backend 2023-10-27 16:36:54 -07:00
Meng Zhang c3e7b470e5
fix: Update Dockerfile 2023-10-27 16:11:10 -07:00
Meng Zhang 361091385d
Update CMakeLists.txt 2023-10-27 15:40:52 -07:00
Meng Zhang 23bd542cec
feat: switch cuda backend to llama.cpp (#656)
* feat: switch cuda backend to llama.cpp

* fix

* fix
2023-10-27 13:41:22 -07:00
Meng Zhang 308681efb0
feat: add an experimental supervisor (#630)
* feat: add an experimental supervisor

* update
2023-10-27 12:46:08 -07:00
Meng Zhang f37cdfef6d docs: update website openapi.json 2023-10-27 12:41:02 -07:00
Meng Zhang ab2297b15c docs: add link to media kit 2023-10-27 12:31:28 -07:00
Meng Zhang 82971758c5 fix: Cargo.lock versioning 2023-10-27 12:26:49 -07:00
Meng Zhang f37840566b
feat: upgrade llama.cpp (#645)
* feat: upgrade llama.cpp

* update download files

* update changelog

* Update CHANGELOG.md

* Update CHANGELOG.md
2023-10-27 12:18:46 -07:00
Meng Zhang 89d1765422
fix model converter script (#655) 2023-10-27 12:15:51 -07:00
Meng Zhang 38402cec56 docs: fix logo 2023-10-27 12:08:55 -07:00