Commit Graph

452 Commits (b990781c9ff3eaa6f09e2ee3a292da3578242866)

Author SHA1 Message Date
Meng Zhang b1f910b727
chore: refactor ci (#196) 2023-06-05 11:30:52 -07:00
Meng Zhang e8b1c10738
feat: add `tabby scheduler` command (#194)
* feat: add `tabby scheduler` command

* update test cases

* fix fmt
2023-06-05 18:29:38 +00:00
Meng Zhang 4e74f7e93b
Update README.md 2023-06-05 01:28:08 -07:00
Meng Zhang f7052f85e9
Update README.md 2023-06-05 01:27:32 -07:00
Meng Zhang 40d8e039b3
fix: neovim expand path (#188) 2023-06-04 21:42:18 -07:00
Meng Zhang da02d471a9
chore: add tabby-scheduler [TAB-17] (#192)
* add scheduler

* update fmt

* add integration tests for scheduler
2023-06-05 03:08:43 +00:00
Meng Zhang 63ca6225ba
cleanup: remove outdated deployment / development dirs (#193) 2023-06-04 19:46:13 -07:00
Meng Zhang 2bf5bcd0cf
refactor: extract TextInferenceEngineImpl to reduce duplications between EncoderDecoderImpl and DecoderImpl #189 2023-06-04 22:28:39 +00:00
Meng Zhang 6de61f45bb
chore: mark thread safety [TAB-52] (#186)
* mark thread safety

* use shared_ptr to ensure thread safety

* fmt
2023-06-04 06:23:31 +00:00
Meng Zhang 775576b53e
fix: only use prompt_template when suffix presents [TAB-46] (#184)
* fix: only use prompt_template when suffix presents

* lint
2023-06-03 17:29:04 +00:00
Meng Zhang 2779da3cba
feat: supports FIM inference [TAB-46] (#183)
* Add prefix / suffix

* update

* feat: support segments in inference

* chore: add tabby.json in model repository to store prompt_template

* make prompt_template optional.

* download tabby.json in downloader
2023-06-02 16:47:48 -07:00
Meng Zhang 950a7a795f fix: when model_id is an local dir, don't try to download model from remote 2023-06-02 13:48:53 -07:00
Zhiming Ma e3eae370be
refactor: Update agent getCompletion interface. (#176) 2023-06-01 20:58:34 -07:00
Meng Zhang b4eaf543b1
Update docker.rust.yml 2023-06-01 18:24:02 -07:00
Meng Zhang 1974168bc0
chore: add release job (#182)
* chore: add release job

* fix tab

* update
2023-06-01 18:01:29 -07:00
Meng Zhang 378f8fa3d5 chore: remove clippy and test is macosx target 2023-06-01 17:25:44 -07:00
Meng Zhang 3cac2607e7
refactor: improve error handlings, fix clippy warnings (#181)
* refactor: minor improvements on error handling

* refactor: cleanup error handlings

* update

* update

* fix

* add clippy / test workflow

* fix clippy

* fix clippy

* update
2023-06-01 17:23:05 -07:00
Meng Zhang 4c6f1338a8
Update README.md 2023-06-01 09:23:19 -07:00
Meng Zhang ca077a3403
feat: ensure model exist before serving (#180)
* chore: migrate completion to new metadata format

* feat: ensure model exist before serving
2023-06-01 07:26:21 +00:00
Meng Zhang 9131567257
chore: migrate completion to new metadata format (#179) 2023-06-01 07:08:09 +00:00
Meng Zhang e8dbd36663
feat: improve download command - support local cache checking behavior (#178)
* move download.rs

* add metadata

* support prefer local args

* fix format

* replace errorchain with anyhow
2023-06-01 06:42:04 +00:00
Meng Zhang 5aa2370e19
feat: switch default docker image to rust based (#175)
* chore: change rust docker image to default

* update README for rust core

* improve doc

* Update README.md

* update

* Update README.md
2023-05-31 23:27:55 +00:00
Meng Zhang bd5fd0592a
fix: tabby agent shouldn't ping a url with trailing slash (#173)
* fix: tabby agent shouldn't ping a url with trailing slash

* remove status 200 check
2023-05-30 23:36:54 -07:00
Meng Zhang 5c0c1463de
chore: set concurrency in workflow (#174) 2023-05-30 23:36:34 -07:00
Meng Zhang b8d67770ee
fix: cors in /, stop words removal (#171) 2023-05-30 17:12:10 -07:00
Meng Zhang f3b37b253b
feat: add events logger (#170)
* add common events

* log events in serve

* formatting

* extract serde_conv

* update

* update

* fix logging

* update
2023-05-30 15:44:29 -07:00
Meng Zhang d8cee4adac
chore: extract tabby-common (#169)
* chore: extract tabby-common

* simplify
2023-05-29 23:39:02 -07:00
Zhiming Ma 781e6a7db3
Bump VSCode Extension version to 0.0.6. (#168) 2023-05-29 23:31:39 -07:00
Zhiming Ma f516b8024c
Update github actions docker.rust.yml to ignore clients changes. (#167) 2023-05-29 20:37:02 -07:00
Meng Zhang 8956056120
fix: support local model path (#165) 2023-05-29 17:40:16 -07:00
Meng Zhang 418558c05d chore: cargo fmt 2023-05-29 17:00:23 -07:00
Meng Zhang 0d11b0e832
Make language field optional in rust implementation (#164)
* remove download_model.py as we have tabby serve now

* Make language field optional
2023-05-29 16:58:02 -07:00
Zhiming Ma a9d74f7a35
Agent: Add completion cache. (#158) 2023-05-28 19:09:44 -07:00
Meng Zhang 48796ecd77
feat: add `tabby download` command (#157)
* simplify fmt-display

* cleanup

* move tabby-admin to reduce nest

* add model downloader

* get rid of model-type

* improve commands

* fix fmt
2023-05-28 14:36:11 -07:00
Meng Zhang 80d1dd1ca6
Add admin panel (behand --experimental-admin-panel) (#156)
* add admin

* add feature:admin_panel

* update

* add dist directory

* update
2023-05-28 01:17:32 -07:00
Meng Zhang b8309d98cc
Switch to sccache (#154)
* fix fmt

* fix

* fix test

* fix clippy

* switch to sc cache

* fix

* update

* update

* update

* fix

* add test

* remove clippy

* update

* disable incremental

* update

* simply
2023-05-27 16:20:17 -07:00
Meng Zhang 0000312460
Add download_model.py. Adjust ctranslate2 backend model structure (#153)
* adjust

* update

* update
2023-05-27 14:51:12 -07:00
Meng Zhang 734957d1de
build mac binary in ci (#152)
* build mac binary in ci

* update

* update

* turn on verbose

* fix cross compile

* update

* update

* update

* update

* update

* update

* update
2023-05-27 14:31:27 -07:00
Meng Zhang 552711a560
Support causal lm (decoder only model) (#151)
* support

* support causal lm
2023-05-27 01:26:33 -07:00
Meng Zhang 72ed30e9ff
Build link shared in docker for ctranslate2 (#150)
* Build link shared in docker

* update

* update
2023-05-27 00:05:56 -07:00
Meng Zhang 06cf34a007
support static linking of ctranslate2 (#148)
* support static linking of ctranslate2

* update

* remove submodule rust-cxx-cmake-bridge

* support alwayslink with whole-archive

* update

* move export_libs

* update docker config

* update ctranslate2

* remove

* update

* update build.rs

* parse external libs

* cleanup

* add cargo fmt
2023-05-26 21:34:31 -07:00
Meng Zhang 3788710882 update Dockerfile.rust 2023-05-26 11:24:18 -07:00
Meng Zhang 135a54b43c
Update Dockerfile.rust 2023-05-26 00:50:03 -07:00
Meng Zhang 7b10340e67 feat: add --port to serve command 2023-05-26 00:32:11 -07:00
Meng Zhang c296b83de9 chore: remove unused lock 2023-05-26 00:06:10 -07:00
Meng Zhang 364cbf8ee0 update Dockerfile.rust 2023-05-25 23:33:03 -07:00
Meng Zhang 8dfe49ec6c
feat: support cuda devices in rust tabby (#149) 2023-05-25 23:23:07 -07:00
Meng Zhang 484e754bc4
Update docker.rust.yml 2023-05-25 20:56:44 -07:00
Meng Zhang ed0b2af837 Update docker.rust.yml 2023-05-25 20:00:12 -07:00
Meng Zhang f5d8bc23c1 fix: checkout submodules in rust ci 2023-05-25 18:53:55 -07:00