2472cf3b55
test: use function call style snippet for prompt builder unit test ( #395 )
...
* test: better tests for build_prefix()
* chore
* chore: resolve comments
2023-09-04 04:54:18 +00:00
74073aa77a
test: add build prefix test and debug chars counting [TAB-184] ( #394 )
...
* test: add count char test
* chore: fix lint
* chore
* chore
2023-09-03 20:57:26 +08:00
3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] ( #390 )
...
* feat: add cargo test to github actions
* chore: fix lint
* chore: add openblas dependency
* chore: update build dependency
* chore: resolve comments
* chore: fix lint
* chore: fix lint
* chore: test installing dependencies
* chore: refactor integ test
* update ci
* cleanup
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
c8339a2912
refactor: use TabbyML/llama.cpp submodule
2023-09-03 12:38:54 +08:00
3acd5d9bc4
refactor: remove llama.cpp subtree
2023-09-03 12:37:26 +08:00
a1ffd54f28
Merge branch 'llama-cpp-support'
2023-09-03 10:44:32 +08:00
92c8ae8ee7
feat: embed ggml-metal.metal
2023-09-03 10:41:03 +08:00
b0074d7e30
feat: support cancellation in llama backend [TAB-146] ( #392 )
...
* feat: support cancellation in llama backend
* fix lint
2023-09-03 02:15:54 +00:00
ed6c5b2e60
Merge commit 'aad80a58b07836bfbf6aedd50993bc54b4257388' as 'crates/llama-cpp-bindings/llama.cpp'
2023-09-03 10:07:10 +08:00
aad80a58b0
Squashed 'crates/llama-cpp-bindings/llama.cpp/' content from commit 3358c381f
...
git-subtree-dir: crates/llama-cpp-bindings/llama.cpp
git-subtree-split: 3358c381f6251bf6e65855e1c93bfaa9ec82ddb3
2023-09-03 10:07:10 +08:00
d4137463ef
remove llama.cpp submodule
2023-09-03 10:04:26 +08:00
e360b438b4
fix lint
2023-09-03 10:01:28 +08:00
3f7aa99b0d
feat: support cancellation in llama backend
2023-09-03 09:59:40 +08:00
3573d4378e
feat: llama.cpp for metal support [TAB-146] ( #391 )
...
* feat: init commit adding llama-cpp-bindings
* add llama.cpp submodule
* add LlamaEngine to hold llama context / llama model
* add cxxbridge
* add basic greedy sampling
* move files
* make compile success
* connect TextGeneration with LlamaEngine
* experimental support llama.cpp
* add metal device
* add Accelerate
* fix namespace for llama-cpp-bindings
* fix lint
* move stepping logic to rust
* add stop words package
* use stop-words in ctranslate2-bindings
* use raw string for regex
* use Arc<Tokenizer> for sharing tokenizers
* refactor: remove useless stop_words_encoding_offset
* switch to tokenizers 0.13.4-rc.3
* fix lints in cpp
* simplify implementation of greedy decoding
* feat: split metal feature for llama backend
* add ci
* update ci
* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
1c1cf44639
feat(agent): added adaptive completion debouncing. ( #389 )
...
* feat(agent): added adaptive completion debouncing.
* chore: bump tabby-agent version to v0.1.0-dev.
2023-09-01 13:30:53 +08:00
5dff349801
add single line comment to languages so they can be used in prompting [TAB-181] ( #388 )
...
* chore: add comment signs to extended languages
* Update crates/tabby/src/serve/completions/prompt.rs
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-01 03:43:27 +00:00
63c00494f3
test: unit tests to prompt builder [TAB-180] ( #387 )
...
* test: unit tests to prompt builder
* chore: fix typo
* chore: fix lint
* chore: resolve comments
2023-09-01 09:20:20 +08:00
90aadad3ce
feat: map js,ts,jsx and tsx to js-ts as unified language [TAB-181] ( #386 )
...
* feat: reduce js, ts, jsx and tsx to js-ts
* chore: refactor and add language reducing to both indexing and dataset jobs
* chore: only reduce language in dataset job
* chore: only reduce language in index job
* chore: fix lint
* chore: resolve comments
2023-08-31 17:21:39 +00:00
e436d63df9
docs: add roadmap for Q4 2023 ( #384 )
...
* docs: add roadmap
* Update 04-roadmap.md
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
---------
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-08-31 17:19:14 +08:00
e5598e63f2
feat: extend language [TAB-181] ( #385 )
...
* feat: extend indexer's language support
* feat: extend language support
* chore: add support for mjs and mts
* chore: fix lint
2023-08-31 07:36:57 +00:00
877a44f815
docs: update README.md
2023-08-31 10:31:54 +08:00
7243285c3b
docs: update openapi.json
2023-08-31 10:29:56 +08:00
ffa87dbfe5
chore: switch to semver for docker.yml
2023-08-31 10:27:21 +08:00
c76edeaa80
Revert "chore: add RELEASE_NOTES.md"
...
This reverts commit cfa0e66c45
2023-08-31 10:11:29 +08:00
b3fe375aff
chore: turn off automatic latest tag
2023-08-31 10:00:19 +08:00
fe3e73c512
chore: fix indent error in docker.yml
2023-08-31 09:50:50 +08:00
cfa0e66c45
chore: add RELEASE_NOTES.md
2023-08-31 09:43:46 +08:00
26fc0e7e64
chore: improve tags with docker/metadata action
2023-08-31 09:36:09 +08:00
c44a9c7195
fix: correct git_describe in /health ( #383 )
...
* fix: add missing Version component in OpenAPI definition
* fix: allow tag / dirty in git describe
2023-08-31 01:06:36 +00:00
41046f8324
chore: turn off binary release for pushes to main
2023-08-31 09:04:01 +08:00
2b5152f734
chore: trigger ci / docker workflows for v* tags
2023-08-31 08:57:06 +08:00
e3d33141e1
fix: don't remove v prefix in release action
2023-08-31 00:09:16 +08:00
4c7cd84df1
chore: change latest tag to
2023-08-30 23:56:27 +08:00
8248a7fd54
chore: support tag in release ( #382 )
2023-08-30 23:42:17 +08:00
c92dd16594
fix: broken link in website footer
2023-08-30 23:15:54 +08:00
133ce9ac56
docs: add faq.md ( #381 )
...
* docs: add 03-faq.md
* docs: add section on reduced precision inference compute capability
* update
2023-08-30 23:09:23 +08:00
57baecb370
fix: switch default running backend to openblas on x86 linux ( #380 )
2023-08-30 14:19:35 +00:00
054aefaf15
chore: add linux static build ( #379 )
...
* chore: add linux static build
* add touch
* update build env
* add sudo
* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
3526ca3164
chore: build with ruy (cpu only) on static mode for linux. ( #378 )
...
* chore: build with ruy (cpu only) on static mode for linux.
* update cmake min version
2023-08-30 18:04:40 +08:00
0eb489b9ca
chore: strip `v` prefix in tag name when tagging docker image
2023-08-30 15:40:40 +08:00
104fea61ad
fix: ref name in docker.yml ( #377 )
2023-08-30 15:28:50 +08:00
f3c20bdf2c
chore: add tag name to image built ( #376 )
2023-08-30 15:11:09 +08:00
f847cb20a3
fix: git information in health API response [TAB-177] ( #375 )
...
* fix: add git information to health API response
* chore: use gitcl
2023-08-29 18:19:54 +08:00
6eae3dc976
docs: add docker run command in README ( #374 )
...
* docs: add docker run command in README
* Update README.md
2023-08-29 10:36:05 +08:00
bd3ae7203e
docs: improve README.md ( #373 )
...
* docs: improve README.md
* Update README.md
* Update README.md
* Update README.md
2023-08-29 10:14:44 +08:00
fc9a623e72
feat: add logging on server starting ( #372 )
2023-08-28 06:12:00 +00:00
65836ee199
feat: add stop words encoding offset for ctranslate model config ( #371 )
...
* feat: add stop words encoding offset for ctranslate model config
* feat: set default suffix to \n
* add special treatment for bytefallback tokens
2023-08-28 14:07:01 +08:00
4da95892ba
chore: bump intellij plugin version 0.2.0. ( #369 )
2023-08-25 00:19:45 +08:00
1e245be721
fix(intellij): fix inlay text rendering. ( #368 )
2023-08-24 17:40:50 +08:00
77fc2be552
fix(agent): improve postprocess: limitScopeByIndentaion. ( #367 )
...
* fix(agent): improve postprocess: limitScopeByIndentaion.
* fix lint.
2023-08-24 13:58:04 +08:00
vodkaslime