Commit Graph

556 Commits (c86c6d8873889ddbf98efcb60768e372aadb73b3)

Author SHA1 Message Date
Xudong Guo c86c6d8873
docs: ✏️ improve contributor docs (#412)
* docs: ✏️ improve contributor docs

* Update README.md

* Update README.md

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-08 08:50:25 +08:00
Meng Zhang bd51f31186
docs: add homebrew instructions for tabby (#411) 2023-09-07 22:04:35 +08:00
Meng Zhang 66bc979aa9 chore: switch to update tag for nightly job 2023-09-07 10:38:50 +08:00
Meng Zhang 426047b04a chore: build release binary for nightly tag 2023-09-07 10:36:47 +08:00
Meng Zhang 74a2b0add6 fix: update permission of nightly job 2023-09-07 10:34:22 +08:00
Meng Zhang c73501100f chore: update nightly.yml 2023-09-07 10:32:33 +08:00
Meng Zhang a6fa940406 fix: correct name for nightly.yml 2023-09-07 10:22:42 +08:00
Meng Zhang 2311adc3f3 fix: add cmake in docker environment 2023-09-07 10:21:46 +08:00
Meng Zhang 9b87b657f0 chore: add nightly branch sync 2023-09-07 10:19:30 +08:00
Meng Zhang e780031ed6
feat: add ggml fp16 / q8_0 files (#407)
* feat: add ggml fp16 / q8_0 files

* add q8_0.gguf to optional download files

* add download options to split ctranslate2 files and ggml files
2023-09-06 17:12:29 +00:00
Meng Zhang 007951b550
Update README.md 2023-09-06 21:20:37 +08:00
Meng Zhang 7367a2625b
docs: Update README.md 2023-09-06 21:20:02 +08:00
Meng Zhang 5b5ce4efe6
docs: Update README.md 2023-09-06 21:18:07 +08:00
Meng Zhang f3c03e903a
docs: add contributing section and build instructions (#405)
* docs: add contributing section and build instructions

* fix

* Update README.md
2023-09-06 21:04:35 +08:00
Meng Zhang 9a59bf3340
docs: add blog on deploy tabby to huggingface space (#397)
* docs: add blog on deploy tabby to huggingface space

* update edit-dockerfile.png

* update index.md

* Update index.md

* docs: editorial changes to blog post

* Update website/blog/2023-09-05-deploy-tabby-to-huggingface-space/index.md

Co-authored-by: Lucy Gao <gyxlucy@gmail.com>

* apply recommendation

* docs: add gyxlucy@ to authors

---------

Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-09-05 21:45:24 +08:00
Zhiming Ma f514e47c2e
feat(agent): add server info in AgentConnected event. (#402) 2023-09-05 15:06:35 +08:00
Meng Zhang a207520571
feat: turn on metal device by default on macosx / aarch64 devices (#398) 2023-09-05 13:03:49 +08:00
Meng Zhang d85cd81139
fix: ensure default suffix to be non-empty (#400) 2023-09-05 03:45:29 +00:00
Zhiming Ma abfa7975e8
feat(intellij): update tabby-agent interface and add issue notifications. (#401) 2023-09-05 11:40:46 +08:00
Xudong Guo 3ab365f2c9
fix: 🐛 Couldn't find package "tabby-agent@0.0.1" (#399) 2023-09-05 11:29:01 +08:00
Meng Zhang e93a971d0e
feat: tune llama metal backend performance (#393)
* feat: support eos based stop

* feat: print performance stats after each inference

* update llama.cpp

* update commits
2023-09-05 10:14:29 +08:00
Meng Zhang 9e54eda318 docs: add emojis to blog, update docusaurus settings 2023-09-04 16:12:05 +08:00
Meng Zhang c15bf91543
docs: add first stable release blog (#396) 2023-09-04 15:46:41 +08:00
Meng Zhang 162978975d docs: add emojis to docs 2023-09-04 14:35:43 +08:00
Meng Zhang 1b7e657afd docs: adjust self-hosting section 2023-09-04 14:23:46 +08:00
vodkaslime 2472cf3b55
test: use function call style snippet for prompt builder unit test (#395)
* test: better tests for build_prefix()

* chore

* chore: resolve comments
2023-09-04 04:54:18 +00:00
vodkaslime 74073aa77a
test: add build prefix test and debug chars counting [TAB-184] (#394)
* test: add count char test

* chore: fix lint

* chore

* chore
2023-09-03 20:57:26 +08:00
vodkaslime 3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390)
* feat: add cargo test to github actions

* chore: fix lint

* chore: add openblas dependency

* chore: update build dependency

* chore: resolve comments

* chore: fix lint

* chore: fix lint

* chore: test installing dependencies

* chore: refactor integ test

* update ci

* cleanup

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
Meng Zhang c8339a2912 refactor: use TabbyML/llama.cpp submodule 2023-09-03 12:38:54 +08:00
Meng Zhang 3acd5d9bc4 refactor: remove llama.cpp subtree 2023-09-03 12:37:26 +08:00
Meng Zhang a1ffd54f28 Merge branch 'llama-cpp-support' 2023-09-03 10:44:32 +08:00
Meng Zhang 92c8ae8ee7 feat: embed ggml-metal.metal 2023-09-03 10:41:03 +08:00
Meng Zhang b0074d7e30
feat: support cancellation in llama backend [TAB-146] (#392)
* feat: support cancellation in llama backend

* fix lint
2023-09-03 02:15:54 +00:00
Meng Zhang ed6c5b2e60 Merge commit 'aad80a58b07836bfbf6aedd50993bc54b4257388' as 'crates/llama-cpp-bindings/llama.cpp' 2023-09-03 10:07:10 +08:00
Meng Zhang aad80a58b0 Squashed 'crates/llama-cpp-bindings/llama.cpp/' content from commit 3358c381f
git-subtree-dir: crates/llama-cpp-bindings/llama.cpp
git-subtree-split: 3358c381f6251bf6e65855e1c93bfaa9ec82ddb3
2023-09-03 10:07:10 +08:00
Meng Zhang d4137463ef remove llama.cpp submodule 2023-09-03 10:04:26 +08:00
Meng Zhang e360b438b4 fix lint 2023-09-03 10:01:28 +08:00
Meng Zhang 3f7aa99b0d feat: support cancellation in llama backend 2023-09-03 09:59:40 +08:00
Meng Zhang 3573d4378e
feat: llama.cpp for metal support [TAB-146] (#391)
* feat: init commit adding llama-cpp-bindings

* add llama.cpp submodule

* add LlamaEngine to hold llama context / llama model

* add cxxbridge

* add basic greedy sampling

* move files

* make compile success

* connect TextGeneration with LlamaEngine

* experimental support llama.cpp

* add metal device

* add Accelerate

* fix namespace for llama-cpp-bindings

* fix lint

* move stepping logic to rust

* add stop words package

* use stop-words in ctranslate2-bindings

* use raw string for regex

* use Arc<Tokenizer> for sharing tokenizers

* refactor: remove useless stop_words_encoding_offset

* switch to tokenizers 0.13.4-rc.3

* fix lints in cpp

* simplify implementation of greedy decoding

* feat: split metal feature for llama backend

* add ci

* update ci

* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
Zhiming Ma 1c1cf44639
feat(agent): added adaptive completion debouncing. (#389)
* feat(agent): added adaptive completion debouncing.

* chore: bump tabby-agent version to v0.1.0-dev.
2023-09-01 13:30:53 +08:00
vodkaslime 5dff349801
add single line comment to languages so they can be used in prompting [TAB-181] (#388)
* chore: add comment signs to extended languages

* Update crates/tabby/src/serve/completions/prompt.rs

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-01 03:43:27 +00:00
vodkaslime 63c00494f3
test: unit tests to prompt builder [TAB-180] (#387)
* test: unit tests to prompt builder

* chore: fix typo

* chore: fix lint

* chore: resolve comments
2023-09-01 09:20:20 +08:00
vodkaslime 90aadad3ce
feat: map js,ts,jsx and tsx to js-ts as unified language [TAB-181] (#386)
* feat: reduce js, ts, jsx and tsx to js-ts

* chore: refactor and add language reducing to both indexing and dataset jobs

* chore: only reduce language in dataset job

* chore: only reduce language in index job

* chore: fix lint

* chore: resolve comments
2023-08-31 17:21:39 +00:00
Meng Zhang e436d63df9
docs: add roadmap for Q4 2023 (#384)
* docs: add roadmap

* Update 04-roadmap.md

* Update website/docs/04-roadmap.md

Co-authored-by: Lucy Gao <gyxlucy@gmail.com>

* Update website/docs/04-roadmap.md

Co-authored-by: Lucy Gao <gyxlucy@gmail.com>

---------

Co-authored-by: Lucy Gao <gyxlucy@gmail.com>
2023-08-31 17:19:14 +08:00
vodkaslime e5598e63f2
feat: extend language [TAB-181] (#385)
* feat: extend indexer's language support

* feat: extend language support

* chore: add support for mjs and mts

* chore: fix lint
2023-08-31 07:36:57 +00:00
Meng Zhang 877a44f815
docs: update README.md 2023-08-31 10:31:54 +08:00
Meng Zhang 7243285c3b docs: update openapi.json 2023-08-31 10:29:56 +08:00
Meng Zhang ffa87dbfe5 chore: switch to semver for docker.yml 2023-08-31 10:27:21 +08:00
Meng Zhang c76edeaa80 Revert "chore: add RELEASE_NOTES.md"
This reverts commit cfa0e66c45.
2023-08-31 10:11:29 +08:00
Meng Zhang b3fe375aff chore: turn off automatic latest tag 2023-08-31 10:00:19 +08:00