Commit Graph

36 Commits (a90db708ddfe40224b23fc805f1dba6733a860b4)

Author SHA1 Message Date
Meng Zhang edd33a326d
feat(loadtest): add loadtest tools (#906)
* add loadtest tools

* update

* [autofix.ci] apply automated fixes

* add readme

* cleanup legacy loadtest

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2023-11-28 14:34:00 +08:00
Meng Zhang d8e83d0610
refactor: extract run_app function (#843)
* refactor: extract run_app function

* lint

* change route to /metrics

* refactor
2023-11-20 01:00:35 +00:00
Jonathan Poisson 6dabecc3ee
feat: add Prometheus support to Tabby. (#838)
* Added Prometheus support to Tabby.

1) Added `axum-prometheus` to Cargo.toml

2) Added `metrics.rs` as a simple route to produce a metrics endpoint with prometheus-formatted events

3) Added `/v1/metrics` endpoint with API doc entry

4) Added the `PrometheusLayer` to the root layers.

This change effectively allows for external Prometheus to scrape metrics from Tabby during execution in order to monitor operations (resources, timings and overall usage).

* changed application/text to text/plain to adhere to rfc1341

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* Update Makefile

* - Reworked code to fit upstream changes
- Added Prometheus layer and handle to worker.rs

* Update CHANGELOG.md

* [autofix.ci] apply automated fixes

* Simplified worker metrics route definition

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

---------

Co-authored-by: Meng Zhang <meng@tabbyml.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2023-11-19 15:40:57 -08:00
Meng Zhang 530e142d63
fix: keep only direct dependency, clean up path (#827) 2023-11-18 08:50:16 +00:00
Meng Zhang e521f0637c
feat: add worker command worker::completion and worker::chat (#778) 2023-11-13 23:21:57 +00:00
Meng Zhang febfa18e4a
refactor: move code api to tabby/serve (#771) 2023-11-12 22:58:15 +00:00
Meng Zhang 4d6dc626c0 chore: switch cargo clippy to nightly 2023-11-12 13:49:42 -08:00
Meng Zhang 15f768a971 feat: add tabby-webserver as distribution layer of tabby #769 2023-11-12 13:07:07 -08:00
Meng Zhang 2ee5dbfd4f
chore: move tabby-ui under ee license. (#667)
* chore: introduce tabby-ui EE license.

* update
2023-10-29 15:56:57 -07:00
Meng Zhang 14d03b6826 fix(ui): handle invalid semver error 2023-10-28 23:30:35 -07:00
Meng Zhang 9ecbf9031f
refactor: rename tabby-playground to tabby-ui (#639) 2023-10-25 23:05:11 +00:00
Meng Zhang 1d31b33ccc chore(eval): move tabby-python-client to eval dir 2023-10-21 16:10:36 -07:00
Meng Zhang 82a94f28d3 chore: add update-python-client to Makefile 2023-10-21 15:49:18 -07:00
Meng Zhang 8a5be05253 chore: remove deprecated field in api doc 2023-10-21 15:40:38 -07:00
Meng Zhang 3f0342ccdf chore: add update-openapi-doc to Makefile 2023-10-21 15:33:37 -07:00
Meng Zhang 98761c2a79
chore: adjust loadtest value based on release v0.3.0 (#572)
* chore: adjust loadtest value based on release v0.3.0

* Update default.loadtest.js
2023-10-16 15:13:26 -07:00
Meng Zhang c5b2d8a074 chore: update bump-version for main branch 2023-10-13 17:53:06 -07:00
Meng Zhang 05038d8b7e force all packages in release branch 2023-10-13 11:43:09 -07:00
Meng Zhang 2385b4a67b chore: add bump-version and bump-release-version in Makefile 2023-10-13 11:28:29 -07:00
Meng Zhang eb15933255
feat: add tabby playground for q&a use case (#493)
* init commit

* support chat

* add theme toggle

* limit message to 2 lines

* update

* update formatting

* update

* update

* update

* fix formatting

* update
2023-09-29 15:51:54 -07:00
Meng Zhang 2983f70d22
feat: build index from dataset (#234) 2023-06-12 19:21:27 +00:00
Meng Zhang fcf9b4345f
refactor: cleanup unused dotfiles (#198) 2023-06-05 12:54:40 -07:00
Meng Zhang 614d993344 test: support TABBY_API_HOST in k6 tests 2023-04-04 11:14:22 +08:00
Meng Zhang a241c08fc3 test: add loadtest 2023-04-02 21:27:08 +08:00
Meng Zhang 796ce8154e test: add smoke tests 2023-04-02 21:26:58 +08:00
Meng Zhang a5afed584f Only install pre-commit in setup-development-environment 2023-03-29 17:04:10 +08:00
Meng Zhang 1c3ec20f93
Prepare public release with a minimal deployment setup (#16)
* Move deployment to deployment-next

* Add deployment setup

* Update deployment-next

* Remove vector label

* update README.md
2023-03-26 22:44:15 +08:00
Meng Zhang b622bd6762
use TabbyML/NeoX-70M for minimal e2e deployment (#10)
* use TabbyML/NeoX-70M for minimal e2e deployment

* Use python3 of triton image
2023-03-25 17:39:40 +08:00
Meng Zhang 8cf533016a
Move python code under tabby/ (#8)
* Add tabby config file

* Rename train.yaml to trainer.yaml

* Change server to relative import

* Move source files into tabby

* Rename conf
2023-03-25 12:20:29 +08:00
Meng Zhang 3407253882 Improve Makefile flags 2023-03-25 00:11:53 +08:00
Meng Zhang 1038bb39a1
Add dagu for data processing job orchestration (#7)
* Install dagu

* Move dagu install to first stage

* Fix metrics

* Add DAGs for create dataset from code repository
2023-03-25 00:05:47 +08:00
Meng Zhang edb3a72ad6 Move python scripts into tasks 2023-03-24 09:58:48 +08:00
Meng Zhang a0b438da06
Add python transformer backend for tabby (mainly used for local dev / test in non-cuda environment) (#6)
* Add python backend

* Split docker-compose.triton.yml

* update makefile
2023-03-23 14:14:33 +08:00
Meng Zhang df149fad61
Reduce repo size (#5)
* Remove binary files from git

* Add Makefile

* update
2023-03-23 13:10:59 +08:00
Meng Zhang e24155fb3a Add pre-commit 2023-03-16 17:56:09 +08:00
Meng Zhang cf27c1a504 Add project preprocessing 2023-03-16 17:26:43 +08:00