Meng Zhang
775576b53e
fix: only use prompt_template when suffix presents [TAB-46] ( #184 )
...
* fix: only use prompt_template when suffix presents
* lint
2023-06-03 17:29:04 +00:00
Meng Zhang
2779da3cba
feat: supports FIM inference [TAB-46] ( #183 )
...
* Add prefix / suffix
* update
* feat: support segments in inference
* chore: add tabby.json in model repository to store prompt_template
* make prompt_template optional.
* download tabby.json in downloader
2023-06-02 16:47:48 -07:00
Meng Zhang
950a7a795f
fix: when model_id is an local dir, don't try to download model from remote
2023-06-02 13:48:53 -07:00
Zhiming Ma
e3eae370be
refactor: Update agent getCompletion interface. ( #176 )
2023-06-01 20:58:34 -07:00
Meng Zhang
b4eaf543b1
Update docker.rust.yml
2023-06-01 18:24:02 -07:00
Meng Zhang
1974168bc0
chore: add release job ( #182 )
...
* chore: add release job
* fix tab
* update
2023-06-01 18:01:29 -07:00
Meng Zhang
378f8fa3d5
chore: remove clippy and test is macosx target
2023-06-01 17:25:44 -07:00
Meng Zhang
3cac2607e7
refactor: improve error handlings, fix clippy warnings ( #181 )
...
* refactor: minor improvements on error handling
* refactor: cleanup error handlings
* update
* update
* fix
* add clippy / test workflow
* fix clippy
* fix clippy
* update
2023-06-01 17:23:05 -07:00
Meng Zhang
4c6f1338a8
Update README.md
2023-06-01 09:23:19 -07:00
Meng Zhang
ca077a3403
feat: ensure model exist before serving ( #180 )
...
* chore: migrate completion to new metadata format
* feat: ensure model exist before serving
2023-06-01 07:26:21 +00:00
Meng Zhang
9131567257
chore: migrate completion to new metadata format ( #179 )
2023-06-01 07:08:09 +00:00
Meng Zhang
e8dbd36663
feat: improve download command - support local cache checking behavior ( #178 )
...
* move download.rs
* add metadata
* support prefer local args
* fix format
* replace errorchain with anyhow
2023-06-01 06:42:04 +00:00
Meng Zhang
5aa2370e19
feat: switch default docker image to rust based ( #175 )
...
* chore: change rust docker image to default
* update README for rust core
* improve doc
* Update README.md
* update
* Update README.md
2023-05-31 23:27:55 +00:00
Meng Zhang
bd5fd0592a
fix: tabby agent shouldn't ping a url with trailing slash ( #173 )
...
* fix: tabby agent shouldn't ping a url with trailing slash
* remove status 200 check
2023-05-30 23:36:54 -07:00
Meng Zhang
5c0c1463de
chore: set concurrency in workflow ( #174 )
2023-05-30 23:36:34 -07:00
Meng Zhang
b8d67770ee
fix: cors in /, stop words removal ( #171 )
2023-05-30 17:12:10 -07:00
Meng Zhang
f3b37b253b
feat: add events logger ( #170 )
...
* add common events
* log events in serve
* formatting
* extract serde_conv
* update
* update
* fix logging
* update
2023-05-30 15:44:29 -07:00
Meng Zhang
d8cee4adac
chore: extract tabby-common ( #169 )
...
* chore: extract tabby-common
* simplify
2023-05-29 23:39:02 -07:00
Zhiming Ma
781e6a7db3
Bump VSCode Extension version to 0.0.6. ( #168 )
2023-05-29 23:31:39 -07:00
Zhiming Ma
f516b8024c
Update github actions docker.rust.yml to ignore clients changes. ( #167 )
2023-05-29 20:37:02 -07:00
Meng Zhang
8956056120
fix: support local model path ( #165 )
2023-05-29 17:40:16 -07:00
Meng Zhang
418558c05d
chore: cargo fmt
2023-05-29 17:00:23 -07:00
Meng Zhang
0d11b0e832
Make language field optional in rust implementation ( #164 )
...
* remove download_model.py as we have tabby serve now
* Make language field optional
2023-05-29 16:58:02 -07:00
Zhiming Ma
a9d74f7a35
Agent: Add completion cache. ( #158 )
2023-05-28 19:09:44 -07:00
Meng Zhang
48796ecd77
feat: add `tabby download` command ( #157 )
...
* simplify fmt-display
* cleanup
* move tabby-admin to reduce nest
* add model downloader
* get rid of model-type
* improve commands
* fix fmt
2023-05-28 14:36:11 -07:00
Meng Zhang
80d1dd1ca6
Add admin panel (behand --experimental-admin-panel) ( #156 )
...
* add admin
* add feature:admin_panel
* update
* add dist directory
* update
2023-05-28 01:17:32 -07:00
Meng Zhang
b8309d98cc
Switch to sccache ( #154 )
...
* fix fmt
* fix
* fix test
* fix clippy
* switch to sc cache
* fix
* update
* update
* update
* fix
* add test
* remove clippy
* update
* disable incremental
* update
* simply
2023-05-27 16:20:17 -07:00
Meng Zhang
0000312460
Add download_model.py. Adjust ctranslate2 backend model structure ( #153 )
...
* adjust
* update
* update
2023-05-27 14:51:12 -07:00
Meng Zhang
734957d1de
build mac binary in ci ( #152 )
...
* build mac binary in ci
* update
* update
* turn on verbose
* fix cross compile
* update
* update
* update
* update
* update
* update
* update
2023-05-27 14:31:27 -07:00
Meng Zhang
552711a560
Support causal lm (decoder only model) ( #151 )
...
* support
* support causal lm
2023-05-27 01:26:33 -07:00
Meng Zhang
72ed30e9ff
Build link shared in docker for ctranslate2 ( #150 )
...
* Build link shared in docker
* update
* update
2023-05-27 00:05:56 -07:00
Meng Zhang
06cf34a007
support static linking of ctranslate2 ( #148 )
...
* support static linking of ctranslate2
* update
* remove submodule rust-cxx-cmake-bridge
* support alwayslink with whole-archive
* update
* move export_libs
* update docker config
* update ctranslate2
* remove
* update
* update build.rs
* parse external libs
* cleanup
* add cargo fmt
2023-05-26 21:34:31 -07:00
Meng Zhang
3788710882
update Dockerfile.rust
2023-05-26 11:24:18 -07:00
Meng Zhang
135a54b43c
Update Dockerfile.rust
2023-05-26 00:50:03 -07:00
Meng Zhang
7b10340e67
feat: add --port to serve command
2023-05-26 00:32:11 -07:00
Meng Zhang
c296b83de9
chore: remove unused lock
2023-05-26 00:06:10 -07:00
Meng Zhang
364cbf8ee0
update Dockerfile.rust
2023-05-25 23:33:03 -07:00
Meng Zhang
8dfe49ec6c
feat: support cuda devices in rust tabby ( #149 )
2023-05-25 23:23:07 -07:00
Meng Zhang
484e754bc4
Update docker.rust.yml
2023-05-25 20:56:44 -07:00
Meng Zhang
ed0b2af837
Update docker.rust.yml
2023-05-25 20:00:12 -07:00
Meng Zhang
f5d8bc23c1
fix: checkout submodules in rust ci
2023-05-25 18:53:55 -07:00
Meng Zhang
c937a5056a
fix docker build
2023-05-25 18:25:34 -07:00
Meng Zhang
0acc975618
Support linux ctranslate2 cuda build ( #147 )
...
* Support linux build
* add <memory> to fix build error in linux
* add Dockerfile.tabby
* update
* update
* add rust docker image pipeline
* add docker.rust.yml
2023-05-25 18:18:22 -07:00
Meng Zhang
80588ddd22
fix: remove wrongly added submodule
2023-05-25 15:08:34 -07:00
Meng Zhang
a2476af373
add ctranslate2-bindings / tabby rust packages ( #146 )
...
* add ctranslate2-bindings
* add fixme for linux build
* turn off shared lib
* add tabby-cli
2023-05-25 14:05:28 -07:00
Zhiming Ma
c08f5acf26
VSCode extension: import agent lib. ( #144 )
2023-05-24 09:21:38 -07:00
Zhiming Ma
ea0252c17d
Refactor to clarify agent interface. ( #142 )
...
* Refactor to clarify agent interface.
* Refactor stdio and extract types.
* Fix notification type.
2023-05-23 18:50:57 -07:00
Zhiming Ma
eb67371cce
Move vim plugin node scripts to agent lib. ( #141 )
...
* Move vim plugin node scripts to agent lib.
* Fix gitignore.
2023-05-22 09:34:56 -07:00
Zhiming Ma
9c3a23ea51
Vim plugin: only trigger completion request when text changed. ( #139 )
2023-05-18 08:48:13 -07:00
Zhiming Ma
2b34d177ba
Vim plugin readability refactor. ( #132 )
2023-05-15 09:42:16 -07:00