Commit Graph

851 Commits (8c680a73fbd65cad80fab98488b5deb2bc4680c5)

Author SHA1 Message Date
Meng Zhang f7ecab5bca
docs: change `consumer` to `client` 2023-09-30 17:42:24 -07:00
Lucy Gao 6348018d38
docs: add back-pressure and cancellation blog (#479)
* docs: add back-pressure and cancellation blog

* fix(doc): format and content improvement for the back-pressure blog (#496)

* Minor editorial changes on cancellation blog.

* adjust blog structure

* rename blog title

---------

Co-authored-by: Wang Zixiao <wayne.wang0821@gmail.com>
Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-30 10:47:09 -07:00
Meng Zhang 2171ba72ff
refactor: cleanup llama cpp implementations to fix warnings (#495) 2023-09-30 08:37:36 -07:00
Meng Zhang aea8c74bdc feat: add OpenAPI link to playground 2023-09-29 18:20:38 -07:00
Meng Zhang 10bf2d6c0c
feat: add param --instruct-model, allowing specify different model for q&a use cases. (#494) 2023-09-29 23:44:53 +00:00
Meng Zhang 892aa61a53
docs: Update tabby-playground/README.md 2023-09-29 15:54:08 -07:00
Meng Zhang eb15933255
feat: add tabby playground for q&a use case (#493)
* init commit

* support chat

* add theme toggle

* limit message to 2 lines

* update

* update formatting

* update

* update

* update

* fix formatting

* update
2023-09-29 15:51:54 -07:00
Meng Zhang 0d6840e372
feat: support request level stop words (#492) 2023-09-29 18:21:57 +00:00
Meng Zhang 486e507079
fix: correct Decoding behavior in incremental manner (#491)
* feat: implement IncrementalDecoding

* refactor: use IncrementalDecoding for ctranslate2

* refactor: rename StopWords to DecodingFactory

* refactor: move decoding logic to tabby-inference

* feat: optimize decoding range

* cleanup
2023-09-29 13:06:47 +00:00
Zhiming Ma 52c4ef38d3
feat(intellij): update tabby-agent to 0.3.1. (#490) 2023-09-29 03:06:47 -07:00
Zhiming Ma 4ebad71805
fix(agent): hotfix vscode extension 0.6.1. Filter out no data AgentStats event. (#489) 2023-09-28 18:58:44 -07:00
Meng Zhang 5d9ca6928c
feat: update llama.cpp (#488)
* feat: update llama.cpp

* remove useless include
2023-09-28 23:59:59 +00:00
Meng Zhang a159c2358d
refactor: move generate / generate_stream to /v1beta (#487) 2023-09-28 23:58:17 +00:00
Meng Zhang 56b7b850af
fix: Linkage issue on latest xcode commandline tools clang (#486) 2023-09-28 17:46:02 +00:00
Meng Zhang 44f013f26e
feat: add /generate and /generate_streaming (#482)
* feat: add generate_stream interface

* extract engine::create_engine

* feat add generate::generate

* support streaming in llama.cpp

* support streaming in ctranslate2

* update

* fix formatting

* refactor: extract helpers functions
2023-09-28 17:20:50 +00:00
Zhiming Ma 1d6ac7836b
chore: bump VSCode extension version 0.6.0. bump tabby-agent version 0.3.0. (#484) 2023-09-27 19:19:31 -07:00
Zhiming Ma 50ac1ced0a
feat(agent): add user properties for anonymous usage tracking. (#483) 2023-09-27 19:15:39 -07:00
Meng Zhang ff4030799a fix: make sure modelscope README.md is longer than 200 characters
fix: update copy-to-modelscope
2023-09-26 21:56:01 -07:00
Zhiming Ma e5340ddf06
chore: add ci test clients. (#476)
* chore: add ci test clients.

* chore: add ci test build intellij plugin.
2023-09-26 21:02:56 -07:00
Meng Zhang 807bcb3927
docs: add archived section in what's new 2023-09-26 12:10:57 -07:00
Meng Zhang d42942c379
feat: support ModelScope for model registry downloading (#477)
* feat: update cache info file after each file got downloaded

* refactor: extract Downloader for model downloading logic

* refactor: extract HuggingFaceRegistry

* refactor: extract serde_json to workspace dependency

* feat: add ModelScopeRegistry

* refactor: extract registry to its sub dir.

* feat: add scripts to mirror hf model to modelscope
2023-09-26 11:52:11 -07:00
Zhiming Ma f75a50de02
Refactor completion request statistics (#474)
* refactor(agent): improve completion provider stats.

* refactor(agent): refactor issues notification and config update.
2023-09-26 03:01:38 -07:00
Zhiming Ma cc83e4d269
fix(vscode): completion view/select event. (#471)
* fix(vscode): completion view/select event.

* chore: bump tabby-agent version 0.3.0-dev.
2023-09-25 09:07:25 +08:00
Meng Zhang 63309d6d6e
docs: Update README.md 2023-09-22 22:44:43 +08:00
Zhexuan Yang c10db58df7
docs: add more detail in contributing guide. (#468)
* docs: add additional step to clone submodules

* Update README.md

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-22 11:20:36 +08:00
Meng Zhang 5b716da378 docs: add default social image 2023-09-22 00:29:00 +08:00
Lucy Gao 1cc1cba56c
docs: add wizardcoder models (#467)
* Update README.md

test

* Update on 10k stars.

* Update README.md on 10k stars.

* doc: add wizardcoder models
2023-09-21 20:54:20 +08:00
Lucy Gao a6eaa273f1
10k star update on README (#466)
* Update README.md

test

* Update on 10k stars.

* Update README.md on 10k stars.
2023-09-21 17:35:59 +08:00
胡锋 fb5a5971d3
feat: proxy server address mapping to the model server (#461)
* feat: proxy server address mapping to the model server

* fix: add swagger in Config

* refactor: add_proxy_server

* fix: missing semicolo
2023-09-21 07:06:51 +00:00
Zhiming Ma 2dbfb0f35b
docs: add troubleshooting clients. (#465) 2023-09-21 11:24:23 +08:00
Zhiming Ma 0aa6c5fcfb
feat(vscode): add manual trigger supporting. (#459)
* feat(vscode): add manual trigger supporting.

* fix: update documents and fix minor bugs.

* fix: lint.
2023-09-19 17:01:36 +08:00
Meng Zhang 61ade26545
feat: Update Dockerfile to ctranslate 3.20.0 (#460) 2023-09-19 14:12:35 +08:00
胡锋 de3a2271d6
fix(tabby): fix swagger's local server use local port (#458)
* fixed: swagger's local server use local port

* fix: extract fn add_localhost_server

* fix: add_localhost_server return doc
2023-09-19 04:36:08 +00:00
Meng Zhang ede704ca05
docs: Update apple.md 2023-09-19 00:53:05 +08:00
samsja eec351f6bf
docs: update vim documentation (#453)
* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* fix: apply suggestions from code review

Co-authored-by: Meng Zhang <meng@tabbyml.com>

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
2023-09-18 16:26:27 +08:00
Meng Zhang fad84325bc
docs: add model spec (unstable) version (#457)
* docs: add model spec (unstable) version

* add link to hf tokenizers
2023-09-18 15:48:03 +08:00
Meng Zhang c4e36ecd79
docs: Update README.md 2023-09-18 12:54:14 +08:00
Meng Zhang 88cbf01a05 fix: correct twitter-img.jpg 2023-09-18 00:35:55 +08:00
Meng Zhang 51d56f74bd docs: update twitter-img 2023-09-18 00:28:55 +08:00
Meng Zhang dc658d6618 docs: set meta image for v0.1.1 blog post 2023-09-18 00:16:43 +08:00
Meng Zhang 9f38b77440
docs: editorial changes for blog post (#455) 2023-09-17 18:03:32 +08:00
Meng Zhang f82c8c7afa docs: fix acknowledge of SDXL-botw 2023-09-17 17:50:03 +08:00
Meng Zhang 40d544bcce docs: acknowlege SDXL-botw and BigCode twitter for topic image 2023-09-17 17:48:48 +08:00
Meng Zhang 05106889d9 docs: improve tabby blogpost 2023-09-17 17:46:15 +08:00
Meng Zhang ac057f8a2f docs: recommend StarCoder-1B for Apple M1/M2 2023-09-17 17:41:29 +08:00
Meng Zhang 0b4206e6f8
docs: add blog for v0.1.1 release (#454) 2023-09-17 17:31:41 +08:00
Meng Zhang c107c991ff chore: bump tabby version to 0.1.1 2023-09-17 17:09:56 +08:00
Meng Zhang 269e7206dd docs: update apple GPU support for StarCoder series 2023-09-16 11:44:42 +08:00
Meng Zhang 97eeb6b926
feat: update llama.cpp to fetch latest starcoder support (#452)
* feat: bump llama.cpp to HEAD

* fix: turn off add_bos by default
2023-09-16 03:41:49 +00:00
Meng Zhang 86e48afbe0 feat: bump ctranslate2 to HEAD 2023-09-16 02:40:23 +08:00