Commit Graph

88 Commits (add-llama-model-converter)

Author SHA1 Message Date
Meng Zhang 1a4c2aa71f
feat: swtich cpu backend to llama.cpp (#638)
* feat: swtich Cpu backend to llama.cpp

* feat: switch cpu serving to ggml

* fix cargo.toml

* use optional dependency

* fix compliation

* update ci target
2023-10-25 15:40:11 -07:00
Zhiming Ma b1437a3b80
fix: github action vim-release. (#611) 2023-10-22 15:54:53 +08:00
Zhiming Ma 800155478c
chore(vim): bump vim plugin version to 1.0.0. (#610) 2023-10-22 00:28:21 -07:00
Meng Zhang 3dd4233dd7 chore: add free-disk step for docker build 2023-10-13 19:01:51 -07:00
Zhiming Ma 52c4ef38d3
feat(intellij): update tabby-agent to 0.3.1. (#490) 2023-09-29 03:06:47 -07:00
Zhiming Ma e5340ddf06
chore: add ci test clients. (#476)
* chore: add ci test clients.

* chore: add ci test build intellij plugin.
2023-09-26 21:02:56 -07:00
Meng Zhang d2700c1597
chore: Update docker.yml 2023-09-08 10:08:42 +08:00
Meng Zhang 81ef570cdf
chore: Update nightly.yml 2023-09-08 10:00:51 +08:00
Meng Zhang 5f1359cb77
chore: Update ci.yml 2023-09-08 09:53:35 +08:00
Meng Zhang daeba63540
chore: Update ci.yml 2023-09-08 09:52:02 +08:00
Meng Zhang 8b269a9f98 fix: nightly.yml 2023-09-08 09:28:42 +08:00
Meng Zhang 2a2a0bc6b4 chore: update nightly workflow 2023-09-08 09:23:56 +08:00
Meng Zhang 66bc979aa9 chore: switch to update tag for nightly job 2023-09-07 10:38:50 +08:00
Meng Zhang 426047b04a chore: build release binary for nightly tag 2023-09-07 10:36:47 +08:00
Meng Zhang 74a2b0add6 fix: update permission of nightly job 2023-09-07 10:34:22 +08:00
Meng Zhang c73501100f chore: update nightly.yml 2023-09-07 10:32:33 +08:00
Meng Zhang a6fa940406 fix: correct name for nightly.yml 2023-09-07 10:22:42 +08:00
Meng Zhang 9b87b657f0 chore: add nightly branch sync 2023-09-07 10:19:30 +08:00
Meng Zhang a207520571
feat: turn on metal device by default on macosx / aarch64 devices (#398) 2023-09-05 13:03:49 +08:00
vodkaslime 3c7c8d9293
feat: add cargo test to github actions and run only unit tests in ci [TAB-185] (#390)
* feat: add cargo test to github actions

* chore: fix lint

* chore: add openblas dependency

* chore: update build dependency

* chore: resolve comments

* chore: fix lint

* chore: fix lint

* chore: test installing dependencies

* chore: refactor integ test

* update ci

* cleanup

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-03 05:04:52 +00:00
Meng Zhang 3573d4378e
feat: llama.cpp for metal support [TAB-146] (#391)
* feat: init commit adding llama-cpp-bindings

* add llama.cpp submodule

* add LlamaEngine to hold llama context / llama model

* add cxxbridge

* add basic greedy sampling

* move files

* make compile success

* connect TextGeneration with LlamaEngine

* experimental support llama.cpp

* add metal device

* add Accelerate

* fix namespace for llama-cpp-bindings

* fix lint

* move stepping logic to rust

* add stop words package

* use stop-words in ctranslate2-bindings

* use raw string for regex

* use Arc<Tokenizer> for sharing tokenizers

* refactor: remove useless stop_words_encoding_offset

* switch to tokenizers 0.13.4-rc.3

* fix lints in cpp

* simplify implementation of greedy decoding

* feat: split metal feature for llama backend

* add ci

* update ci

* build tabby bin in ci build
2023-09-03 09:59:07 +08:00
Meng Zhang ffa87dbfe5 chore: switch to semver for docker.yml 2023-08-31 10:27:21 +08:00
Meng Zhang c76edeaa80 Revert "chore: add RELEASE_NOTES.md"
This reverts commit cfa0e66c45.
2023-08-31 10:11:29 +08:00
Meng Zhang b3fe375aff chore: turn off automatic latest tag 2023-08-31 10:00:19 +08:00
Meng Zhang fe3e73c512 chore: fix indent error in docker.yml 2023-08-31 09:50:50 +08:00
Meng Zhang cfa0e66c45 chore: add RELEASE_NOTES.md 2023-08-31 09:43:46 +08:00
Meng Zhang 26fc0e7e64 chore: improve tags with docker/metadata action 2023-08-31 09:36:09 +08:00
Meng Zhang 41046f8324 chore: turn off binary release for pushes to main 2023-08-31 09:04:01 +08:00
Meng Zhang 2b5152f734 chore: trigger ci / docker workflows for v* tags 2023-08-31 08:57:06 +08:00
Meng Zhang e3d33141e1 fix: don't remove v prefix in release action 2023-08-31 00:09:16 +08:00
Meng Zhang 4c7cd84df1 chore: change latest tag to 2023-08-30 23:56:27 +08:00
Meng Zhang 8248a7fd54
chore: support tag in release (#382) 2023-08-30 23:42:17 +08:00
Meng Zhang 054aefaf15
chore: add linux static build (#379)
* chore: add linux static build

* add touch

* update build env

* add sudo

* fix: protobuf ubuntu target
2023-08-30 18:45:05 +08:00
Meng Zhang 0eb489b9ca
chore: strip `v` prefix in tag name when tagging docker image 2023-08-30 15:40:40 +08:00
Meng Zhang 104fea61ad
fix: ref name in docker.yml (#377) 2023-08-30 15:28:50 +08:00
Meng Zhang f3c20bdf2c
chore: add tag name to image built (#376) 2023-08-30 15:11:09 +08:00
Meng Zhang 7ed5dd584d
feat: experiment ctags support in scheduler (#207)
* experiment ctags support

* add document.rs

* extract Document to common

* integrate tags into dataset builder

* skip if none

* do not add scheduler in client binary

* fix fmt
2023-06-21 19:48:13 -07:00
Meng Zhang 5ab286814a chore: set push to true 2023-06-11 15:14:22 -07:00
Meng Zhang de546b03fe
feat: add otlp-endpoint for OpenTelemetry support [TAB-67] (#227)
* feat: add otlp-endpoint for OpenTelemetry support

* set default log level for axum tracing to INFO

* update build enviornment

* update
2023-06-10 22:46:25 -07:00
Meng Zhang b184fae2c9
chore: Update gh-pages.yml 2023-06-06 16:32:51 -07:00
Meng Zhang 787e195359
chore: update gh-pages.yml 2023-06-06 16:25:08 -07:00
Meng Zhang 9eec9eae5d chore: update ci 2023-06-06 04:23:16 -07:00
Meng Zhang 1d0fe5ad76
docs: add demo.gif to website (#206)
* docs: add demo.gif to website

* add changes filter
2023-06-06 04:21:30 -07:00
Meng Zhang 0c290f18c3
Update gh-pages.yml (#202) 2023-06-05 18:50:45 -07:00
Meng Zhang b3a9363b82
Update gh-pages.yml 2023-06-05 18:48:34 -07:00
Meng Zhang 892bad5f8a
Update gh-pages.yml (#201) 2023-06-05 18:47:14 -07:00
Meng Zhang 23e8795ff6
Create gh-pages.yml 2023-06-05 18:39:49 -07:00
Meng Zhang 272dde9769
refactor: rust nightly format (#197)
* chore: turn on group format

* turn on nightly fmt
2023-06-05 14:17:07 -07:00
Meng Zhang b1f910b727
chore: refactor ci (#196) 2023-06-05 11:30:52 -07:00
Meng Zhang 63ca6225ba
cleanup: remove outdated deployment / development dirs (#193) 2023-06-04 19:46:13 -07:00