9a59bf3340
docs: add blog on deploy tabby to huggingface space ( #397 )
...
* docs: add blog on deploy tabby to huggingface space
* update edit-dockerfile.png
* update index.md
* Update index.md
* docs: editorial changes to blog post
* Update website/blog/2023-09-05-deploy-tabby-to-huggingface-space/index.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
* apply recommendation
* docs: add gyxlucy@ to authors
---------
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-09-05 21:45:24 +08:00
f514e47c2e
feat(agent): add server info in AgentConnected event. ( #402 )
2023-09-05 15:06:35 +08:00
a207520571
feat: turn on metal device by default on macosx / aarch64 devices ( #398 )
2023-09-05 13:03:49 +08:00
d85cd81139
fix: ensure default suffix to be non-empty ( #400 )
2023-09-05 03:45:29 +00:00
abfa7975e8
feat(intellij): update tabby-agent interface and add issue notifications. ( #401 )
2023-09-05 11:40:46 +08:00
3ab365f2c9
fix: 🐛 Couldn't find package "tabby-agent@0.0.1" ( #399 )
2023-09-05 11:29:01 +08:00
e93a971d0e
feat: tune llama metal backend performance ( #393 )
...
* feat: support eos based stop
* feat: print performance stats after each inference
* update llama.cpp
* update commits
2023-09-05 10:14:29 +08:00
9e54eda318
docs: add emojis to blog, update docusaurus settings
2023-09-04 16:12:05 +08:00
c15bf91543
docs: add first stable release blog ( #396 )
2023-09-04 15:46:41 +08:00
162978975d
docs: add emojis to docs
2023-09-04 14:35:43 +08:00
1b7e657afd
docs: adjust self-hosting section
2023-09-04 14:23:46 +08:00
2472cf3b55
test: use function call style snippet for prompt builder unit test ( #395 )
...
* test: better tests for build_prefix()
* chore
* chore: resolve comments
2023-09-04 04:54:18 +00:00
74073aa77a
test: add build prefix test and debug chars counting [TAB-184] ( #394 )
...
* test: add count char test
* chore: fix lint
* chore
* chore
2023-09-03 20:57:26 +08:00
3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] ( #390 )
...
* feat: add cargo test to github actions
* chore: fix lint
* chore: add openblas dependency
* chore: update build dependency
* chore: resolve comments
* chore: fix lint
* chore: fix lint
* chore: test installing dependencies
* chore: refactor integ test
* update ci
* cleanup
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
c8339a2912
refactor: use TabbyML/llama.cpp submodule
2023-09-03 12:38:54 +08:00
3acd5d9bc4
refactor: remove llama.cpp subtree
2023-09-03 12:37:26 +08:00
a1ffd54f28
Merge branch 'llama-cpp-support'
2023-09-03 10:44:32 +08:00
92c8ae8ee7
feat: embed ggml-metal.metal
2023-09-03 10:41:03 +08:00
b0074d7e30
feat: support cancellation in llama backend [TAB-146] ( #392 )
...
* feat: support cancellation in llama backend
* fix lint
2023-09-03 02:15:54 +00:00
ed6c5b2e60
Merge commit 'aad80a58b07836bfbf6aedd50993bc54b4257388' as 'crates/llama-cpp-bindings/llama.cpp'
2023-09-03 10:07:10 +08:00
aad80a58b0
Squashed 'crates/llama-cpp-bindings/llama.cpp/' content from commit 3358c381f
...
git-subtree-dir: crates/llama-cpp-bindings/llama.cpp
git-subtree-split: 3358c381f6251bf6e65855e1c93bfaa9ec82ddb3
2023-09-03 10:07:10 +08:00
d4137463ef
remove llama.cpp submodule
2023-09-03 10:04:26 +08:00
e360b438b4
fix lint
2023-09-03 10:01:28 +08:00
3f7aa99b0d
feat: support cancellation in llama backend
2023-09-03 09:59:40 +08:00
3573d4378e
feat: llama.cpp for metal support [TAB-146] ( #391 )
...
* feat: init commit adding llama-cpp-bindings
* add llama.cpp submodule
* add LlamaEngine to hold llama context / llama model
* add cxxbridge
* add basic greedy sampling
* move files
* make compile success
* connect TextGeneration with LlamaEngine
* experimental support llama.cpp
* add metal device
* add Accelerate
* fix namespace for llama-cpp-bindings
* fix lint
* move stepping logic to rust
* add stop words package
* use stop-words in ctranslate2-bindings
* use raw string for regex
* use Arc<Tokenizer> for sharing tokenizers
* refactor: remove useless stop_words_encoding_offset
* switch to tokenizers 0.13.4-rc.3
* fix lints in cpp
* simplify implementation of greedy decoding
* feat: split metal feature for llama backend
* add ci
* update ci
* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
1c1cf44639
feat(agent): added adaptive completion debouncing. ( #389 )
...
* feat(agent): added adaptive completion debouncing.
* chore: bump tabby-agent version to v0.1.0-dev.
2023-09-01 13:30:53 +08:00
5dff349801
add single line comment to languages so they can be used in prompting [TAB-181] ( #388 )
...
* chore: add comment signs to extended languages
* Update crates/tabby/src/serve/completions/prompt.rs
---------
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-01 03:43:27 +00:00
63c00494f3
test: unit tests to prompt builder [TAB-180] ( #387 )
...
* test: unit tests to prompt builder
* chore: fix typo
* chore: fix lint
* chore: resolve comments
2023-09-01 09:20:20 +08:00
90aadad3ce
feat: map js,ts,jsx and tsx to js-ts as unified language [TAB-181] ( #386 )
...
* feat: reduce js, ts, jsx and tsx to js-ts
* chore: refactor and add language reducing to both indexing and dataset jobs
* chore: only reduce language in dataset job
* chore: only reduce language in index job
* chore: fix lint
* chore: resolve comments
2023-08-31 17:21:39 +00:00
e436d63df9
docs: add roadmap for Q4 2023 ( #384 )
...
* docs: add roadmap
* Update 04-roadmap.md
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
* Update website/docs/04-roadmap.md
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
---------
Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-08-31 17:19:14 +08:00
e5598e63f2
feat: extend language [TAB-181] ( #385 )
...
* feat: extend indexer's language support
* feat: extend language support
* chore: add support for mjs and mts
* chore: fix lint
2023-08-31 07:36:57 +00:00
877a44f815
docs: update README.md
2023-08-31 10:31:54 +08:00
7243285c3b
docs: update openapi.json
2023-08-31 10:29:56 +08:00
ffa87dbfe5
chore: switch to semver for docker.yml
2023-08-31 10:27:21 +08:00
c76edeaa80
Revert "chore: add RELEASE_NOTES.md"
...
This reverts commit cfa0e66c45
2023-08-31 10:11:29 +08:00
b3fe375aff
chore: turn off automatic latest tag
2023-08-31 10:00:19 +08:00
fe3e73c512
chore: fix indent error in docker.yml
2023-08-31 09:50:50 +08:00
cfa0e66c45
chore: add RELEASE_NOTES.md
2023-08-31 09:43:46 +08:00
26fc0e7e64
chore: improve tags with docker/metadata action
2023-08-31 09:36:09 +08:00
c44a9c7195
fix: correct git_describe in /health ( #383 )
...
* fix: add missing Version component in OpenAPI definition
* fix: allow tag / dirty in git describe
2023-08-31 01:06:36 +00:00
41046f8324
chore: turn off binary release for pushes to main
2023-08-31 09:04:01 +08:00
2b5152f734
chore: trigger ci / docker workflows for v* tags
2023-08-31 08:57:06 +08:00
e3d33141e1
fix: don't remove v prefix in release action
2023-08-31 00:09:16 +08:00
4c7cd84df1
chore: change latest tag to
2023-08-30 23:56:27 +08:00
8248a7fd54
chore: support tag in release ( #382 )
2023-08-30 23:42:17 +08:00
c92dd16594
fix: broken link in website footer
2023-08-30 23:15:54 +08:00
133ce9ac56
docs: add faq.md ( #381 )
...
* docs: add 03-faq.md
* docs: add section on reduced precision inference compute capability
* update
2023-08-30 23:09:23 +08:00
57baecb370
fix: switch default running backend to openblas on x86 linux ( #380 )
2023-08-30 14:19:35 +00:00
054aefaf15
chore: add linux static build ( #379 )
...
* chore: add linux static build
* add touch
* update build env
* add sudo
* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
3526ca3164
chore: build with ruy (cpu only) on static mode for linux. ( #378 )
...
* chore: build with ruy (cpu only) on static mode for linux.
* update cmake min version
2023-08-30 18:04:40 +08:00
Meng Zhang