aad80a58b0
Squashed 'crates/llama-cpp-bindings/llama.cpp/' content from commit 3358c381f
...
git-subtree-dir: crates/llama-cpp-bindings/llama.cpp
git-subtree-split: 3358c381f6251bf6e65855e1c93bfaa9ec82ddb3
2023-09-03 10:07:10 +08:00
d4137463ef
remove llama.cpp submodule
2023-09-03 10:04:26 +08:00
e360b438b4
fix lint
2023-09-03 10:01:28 +08:00
3f7aa99b0d
feat: support cancellation in llama backend
2023-09-03 09:59:40 +08:00
3573d4378e
feat: llama.cpp for metal support [TAB-146] ( #391 )
...
* feat: init commit adding llama-cpp-bindings
* add llama.cpp submodule
* add LlamaEngine to hold llama context / llama model
* add cxxbridge
* add basic greedy sampling
* move files
* make compile success
* connect TextGeneration with LlamaEngine
* experimental support llama.cpp
* add metal device
* add Accelerate
* fix namespace for llama-cpp-bindings
* fix lint
* move stepping logic to rust
* add stop words package
* use stop-words in ctranslate2-bindings
* use raw string for regex
* use Arc<Tokenizer> for sharing tokenizers
* refactor: remove useless stop_words_encoding_offset
* switch to tokenizers 0.13.4-rc.3
* fix lints in cpp
* simplify implementation of greedy decoding
* feat: split metal feature for llama backend
* add ci
* update ci
* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
1c1cf44639
feat(agent): added adaptive completion debouncing. ( #389 )
...
* feat(agent): added adaptive completion debouncing.
* chore: bump tabby-agent version to v0.1.0-dev.
2023-09-01 13:30:53 +08:00
5dff349801
add single line comment to languages so they can be used in prompting [TAB-181] ( #388 )
...
* chore: add comment signs to extended languages
* Update crates/tabby/src/serve/completions/prompt.rs
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-01 03:43:27 +00:00
63c00494f3
test: unit tests to prompt builder [TAB-180] ( #387 )
...
* test: unit tests to prompt builder
* chore: fix typo
* chore: fix lint
* chore: resolve comments
2023-09-01 09:20:20 +08:00
90aadad3ce
feat: map js,ts,jsx and tsx to js-ts as unified language [TAB-181] ( #386 )
...
* feat: reduce js, ts, jsx and tsx to js-ts
* chore: refactor and add language reducing to both indexing and dataset jobs
* chore: only reduce language in dataset job
* chore: only reduce language in index job
* chore: fix lint
* chore: resolve comments
2023-08-31 17:21:39 +00:00
e436d63df9
docs: add roadmap for Q4 2023 ( #384 )
...
* docs: add roadmap
* Update 04-roadmap.md
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
---------
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-08-31 17:19:14 +08:00
e5598e63f2
feat: extend language [TAB-181] ( #385 )
...
* feat: extend indexer's language support
* feat: extend language support
* chore: add support for mjs and mts
* chore: fix lint
2023-08-31 07:36:57 +00:00
877a44f815
docs: update README.md
2023-08-31 10:31:54 +08:00
7243285c3b
docs: update openapi.json
2023-08-31 10:29:56 +08:00
ffa87dbfe5
chore: switch to semver for docker.yml
2023-08-31 10:27:21 +08:00
c76edeaa80
Revert "chore: add RELEASE_NOTES.md"
...
This reverts commit cfa0e66c45
2023-08-31 10:11:29 +08:00
b3fe375aff
chore: turn off automatic latest tag
2023-08-31 10:00:19 +08:00
fe3e73c512
chore: fix indent error in docker.yml
2023-08-31 09:50:50 +08:00
cfa0e66c45
chore: add RELEASE_NOTES.md
2023-08-31 09:43:46 +08:00
26fc0e7e64
chore: improve tags with docker/metadata action
2023-08-31 09:36:09 +08:00
c44a9c7195
fix: correct git_describe in /health ( #383 )
...
* fix: add missing Version component in OpenAPI definition
* fix: allow tag / dirty in git describe
2023-08-31 01:06:36 +00:00
41046f8324
chore: turn off binary release for pushes to main
2023-08-31 09:04:01 +08:00
2b5152f734
chore: trigger ci / docker workflows for v* tags
2023-08-31 08:57:06 +08:00
e3d33141e1
fix: don't remove v prefix in release action
2023-08-31 00:09:16 +08:00
4c7cd84df1
chore: change latest tag to
2023-08-30 23:56:27 +08:00
8248a7fd54
chore: support tag in release ( #382 )
2023-08-30 23:42:17 +08:00
c92dd16594
fix: broken link in website footer
2023-08-30 23:15:54 +08:00
133ce9ac56
docs: add faq.md ( #381 )
...
* docs: add 03-faq.md
* docs: add section on reduced precision inference compute capability
* update
2023-08-30 23:09:23 +08:00
57baecb370
fix: switch default running backend to openblas on x86 linux ( #380 )
2023-08-30 14:19:35 +00:00
054aefaf15
chore: add linux static build ( #379 )
...
* chore: add linux static build
* add touch
* update build env
* add sudo
* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
3526ca3164
chore: build with ruy (cpu only) on static mode for linux. ( #378 )
...
* chore: build with ruy (cpu only) on static mode for linux.
* update cmake min version
2023-08-30 18:04:40 +08:00
0eb489b9ca
chore: strip `v` prefix in tag name when tagging docker image
2023-08-30 15:40:40 +08:00
104fea61ad
fix: ref name in docker.yml ( #377 )
2023-08-30 15:28:50 +08:00
f3c20bdf2c
chore: add tag name to image built ( #376 )
2023-08-30 15:11:09 +08:00
f847cb20a3
fix: git information in health API response [TAB-177] ( #375 )
...
* fix: add git information to health API response
* chore: use gitcl
2023-08-29 18:19:54 +08:00
6eae3dc976
docs: add docker run command in README ( #374 )
...
* docs: add docker run command in README
* Update README.md
2023-08-29 10:36:05 +08:00
bd3ae7203e
docs: improve README.md ( #373 )
...
* docs: improve README.md
* Update README.md
* Update README.md
* Update README.md
2023-08-29 10:14:44 +08:00
fc9a623e72
feat: add logging on server starting ( #372 )
2023-08-28 06:12:00 +00:00
65836ee199
feat: add stop words encoding offset for ctranslate model config ( #371 )
...
* feat: add stop words encoding offset for ctranslate model config
* feat: set default suffix to \n
* add special treatment for bytefallback tokens
2023-08-28 14:07:01 +08:00
4da95892ba
chore: bump intellij plugin version 0.2.0. ( #369 )
2023-08-25 00:19:45 +08:00
1e245be721
fix(intellij): fix inlay text rendering. ( #368 )
2023-08-24 17:40:50 +08:00
77fc2be552
fix(agent): improve postprocess: limitScopeByIndentaion. ( #367 )
...
* fix(agent): improve postprocess: limitScopeByIndentaion.
* fix lint.
2023-08-24 13:58:04 +08:00
4a8a14afdf
docs: add jetbrains downloads to README ( #366 )
2023-08-22 00:05:19 +08:00
2a91a21787
feat: add gpu info to health state [TAB-162] ( #364 )
...
* feat: add gpu info to health response
* chore: error handling
* chore: refactor cpu manager code
* chore: typo
* chore: fix context mutability
* chore: fix context mutability
* feat: add link to NVML lib
* chore: refactor
* lint
* chore: resolve comments
* chore: fix typo
* chore: fix
* chore: resolve comments
* chore: fix
* chore: resolve comments
2023-08-21 18:06:38 +08:00
bdda8a534f
feat(intellij): add anonymous usage event IntelliJInitFailed. ( #365 )
...
* feat(intellij): add anonymous usage event plugin activated.
* fix(intellij): post event IntelliJinitFailed only when failed instead of PluginActivated.
2023-08-21 13:51:41 +08:00
b1ad936033
feat: add version information in health state. ( #363 )
...
* feat: add git_hash in health state
* add more version information in health state
2023-08-20 15:21:12 +00:00
df45573501
feat: reduce ServeHealth event to every 300s to reduce event volume ( #362 )
2023-08-20 12:36:59 +00:00
3a2262429a
chore: bump VSCode extension version 0.3.0. ( #361 )
2023-08-18 10:55:57 +08:00
b4381acfbf
feat: add model-converter [TAB-153] ( #357 )
...
* feat: add transformers-to-ctranslate
* chore: resolve comments
* chore: fix
* chore: remove dotenv
* chore: resolve comments
* chore: lint
* chore: change dir name
2023-08-17 22:29:20 +08:00
732d83feef
feat(agent): monitor completion response time. ( #359 )
...
* feat(agent): monitor completion response time.
* fix(agent): improve help message for running large model on cpu.
* fix: notification spacing.
2023-08-17 22:28:41 +08:00
2026b4dd0e
feat: add architecture/cpu info to health api response [TAB-162] ( #355 )
...
* feat: add architecture, cpu and gpu info to health command
* chore: fix
* chore: fix
* chore: fix
* chore: fix lint
* chore: fix lint
* chore: remove gpu
* chore: resolve comments
* chore: resolve comments
* Update health.rs
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-08-15 15:22:03 +00:00
Meng Zhang