Meng Zhang
fd1baff8d5
feat: support stop sequences [TAB-52] ( #212 )
...
* refactor: pass step and string token to callback
* add token to callback
* add stop regexp
* implement stop words logic
* pass token_ids from inference
* improve effiency of regexp match with reversed regex
* fmt
* add typescript and javascript stop words
* add cache for stop words regexp
2023-06-06 23:28:58 +00:00
Meng Zhang
787e195359
chore: update gh-pages.yml
2023-06-06 16:25:08 -07:00
Zhiming Ma
e8a1688fce
feat: add tabby-agent loggers. ( #210 )
2023-06-06 07:25:31 -07:00
Zhiming Ma
bc90ff4b7e
refactor: agent configuration interface ( #209 )
...
* refactor: Agent configuration interface.
* Simplify agent logs config.
* Rename analytics to anonymousUsageTracking.
2023-06-06 06:29:04 -07:00
Zhiming Ma
acd1613d19
Update server.md ( #211 )
...
Create `~/.tabby` manually, to avoid directory will be created by dockerd if not exist, which will result in directory owned by `root`.
2023-06-06 06:08:56 -07:00
Meng Zhang
007a40c582
feat: support early stop [TAB-51] ( #208 )
...
* bump ctranslate2 to v3.15.0
* enable early stop
* support early stop
2023-06-06 12:46:17 +00:00
Meng Zhang
e44dfc1c04
docs: update footer name
2023-06-06 04:27:15 -07:00
Meng Zhang
9eec9eae5d
chore: update ci
2023-06-06 04:23:16 -07:00
Meng Zhang
1d0fe5ad76
docs: add demo.gif to website ( #206 )
...
* docs: add demo.gif to website
* add changes filter
2023-06-06 04:21:30 -07:00
vodkaslime
6f6874d56d
minor fix to gpu serving command ( #205 )
2023-06-05 20:26:01 -07:00
Meng Zhang
fb60a3f3d6
docs: fix build
2023-06-05 19:46:54 -07:00
Meng Zhang
08b860081c
docs: update server.md ( #204 )
2023-06-05 19:42:58 -07:00
Meng Zhang
9973b7ba66
docs: add openapi.json ( #203 )
...
* docs: update
* update
* update docs
* docs: add openai.json
* update
2023-06-05 19:38:56 -07:00
Meng Zhang
0c290f18c3
Update gh-pages.yml ( #202 )
2023-06-05 18:50:45 -07:00
Meng Zhang
b3a9363b82
Update gh-pages.yml
2023-06-05 18:48:34 -07:00
Meng Zhang
892bad5f8a
Update gh-pages.yml ( #201 )
2023-06-05 18:47:14 -07:00
Meng Zhang
23e8795ff6
Create gh-pages.yml
2023-06-05 18:39:49 -07:00
Meng Zhang
5546794b65
rename docs to website
2023-06-05 18:39:33 -07:00
Meng Zhang
daf10a1918
init commit ( #200 )
2023-06-05 18:33:54 -07:00
Meng Zhang
6a650eb5a6
Create configuration.md
...
Fixes #91
2023-06-05 17:58:10 -07:00
Meng Zhang
e781f31466
Delete Events.md
2023-06-05 17:47:35 -07:00
Meng Zhang
239792dadd
Update README.md
2023-06-05 17:38:54 -07:00
Meng Zhang
4b7ff39306
Update README.md
2023-06-05 17:14:43 -07:00
Meng Zhang
3c4ebb99fd
Update README.md
2023-06-05 17:14:16 -07:00
Meng Zhang
249d51d0f5
feat: add indexer [TAB-17] ( #199 )
...
* add basic indexer
* formatting
2023-06-05 22:18:10 +00:00
Meng Zhang
272dde9769
refactor: rust nightly format ( #197 )
...
* chore: turn on group format
* turn on nightly fmt
2023-06-05 14:17:07 -07:00
Meng Zhang
f4442b104f
docs: usage string for scheduler
2023-06-05 12:57:18 -07:00
Meng Zhang
fcf9b4345f
refactor: cleanup unused dotfiles ( #198 )
2023-06-05 12:54:40 -07:00
Meng Zhang
e8a33312bb
refactor: extract download into tabby-download ( #195 )
...
* refactor: extract download into tabby-download
* remove unused deps
2023-06-05 18:40:24 +00:00
Meng Zhang
b1f910b727
chore: refactor ci ( #196 )
2023-06-05 11:30:52 -07:00
Meng Zhang
e8b1c10738
feat: add `tabby scheduler` command ( #194 )
...
* feat: add `tabby scheduler` command
* update test cases
* fix fmt
2023-06-05 18:29:38 +00:00
Meng Zhang
4e74f7e93b
Update README.md
2023-06-05 01:28:08 -07:00
Meng Zhang
f7052f85e9
Update README.md
2023-06-05 01:27:32 -07:00
Meng Zhang
40d8e039b3
fix: neovim expand path ( #188 )
2023-06-04 21:42:18 -07:00
Meng Zhang
da02d471a9
chore: add tabby-scheduler [TAB-17] ( #192 )
...
* add scheduler
* update fmt
* add integration tests for scheduler
2023-06-05 03:08:43 +00:00
Meng Zhang
63ca6225ba
cleanup: remove outdated deployment / development dirs ( #193 )
2023-06-04 19:46:13 -07:00
Meng Zhang
2bf5bcd0cf
refactor: extract TextInferenceEngineImpl to reduce duplications between EncoderDecoderImpl and DecoderImpl #189
2023-06-04 22:28:39 +00:00
Meng Zhang
6de61f45bb
chore: mark thread safety [TAB-52] ( #186 )
...
* mark thread safety
* use shared_ptr to ensure thread safety
* fmt
2023-06-04 06:23:31 +00:00
Meng Zhang
775576b53e
fix: only use prompt_template when suffix presents [TAB-46] ( #184 )
...
* fix: only use prompt_template when suffix presents
* lint
2023-06-03 17:29:04 +00:00
Meng Zhang
2779da3cba
feat: supports FIM inference [TAB-46] ( #183 )
...
* Add prefix / suffix
* update
* feat: support segments in inference
* chore: add tabby.json in model repository to store prompt_template
* make prompt_template optional.
* download tabby.json in downloader
2023-06-02 16:47:48 -07:00
Meng Zhang
950a7a795f
fix: when model_id is an local dir, don't try to download model from remote
2023-06-02 13:48:53 -07:00
Zhiming Ma
e3eae370be
refactor: Update agent getCompletion interface. ( #176 )
2023-06-01 20:58:34 -07:00
Meng Zhang
b4eaf543b1
Update docker.rust.yml
2023-06-01 18:24:02 -07:00
Meng Zhang
1974168bc0
chore: add release job ( #182 )
...
* chore: add release job
* fix tab
* update
2023-06-01 18:01:29 -07:00
Meng Zhang
378f8fa3d5
chore: remove clippy and test is macosx target
2023-06-01 17:25:44 -07:00
Meng Zhang
3cac2607e7
refactor: improve error handlings, fix clippy warnings ( #181 )
...
* refactor: minor improvements on error handling
* refactor: cleanup error handlings
* update
* update
* fix
* add clippy / test workflow
* fix clippy
* fix clippy
* update
2023-06-01 17:23:05 -07:00
Meng Zhang
4c6f1338a8
Update README.md
2023-06-01 09:23:19 -07:00
Meng Zhang
ca077a3403
feat: ensure model exist before serving ( #180 )
...
* chore: migrate completion to new metadata format
* feat: ensure model exist before serving
2023-06-01 07:26:21 +00:00
Meng Zhang
9131567257
chore: migrate completion to new metadata format ( #179 )
2023-06-01 07:08:09 +00:00
Meng Zhang
e8dbd36663
feat: improve download command - support local cache checking behavior ( #178 )
...
* move download.rs
* add metadata
* support prefer local args
* fix format
* replace errorchain with anyhow
2023-06-01 06:42:04 +00:00