Go to file
Zhiming Ma efe2dcbb0f
refactor(agent): agent http request and cancellation flow. (#446)
* refactor(agent): refactor http request and cancellation flow.

* fix: minor fixes.

* fix: minor fix cheking timeout error in stats.
2023-09-15 11:05:46 +08:00
.github chore: Update docker.yml 2023-09-08 10:08:42 +08:00
ci Revert "chore: add RELEASE_NOTES.md" 2023-08-31 10:11:29 +08:00
clients refactor(agent): agent http request and cancellation flow. (#446) 2023-09-15 11:05:46 +08:00
crates feat: add LLAMA_CPP_LOG_LEVEL to control log level of llama.cpp (#436) 2023-09-12 14:41:39 +00:00
experimental chore: uncomment (#413) 2023-09-08 10:31:29 +08:00
python/tabby feat: cleanup trainer with new data format 2023-06-13 12:48:27 -07:00
tests test: support TABBY_API_HOST in k6 tests 2023-04-04 11:14:22 +08:00
website docs: add device recommendations based on model size 2023-09-14 14:07:31 +08:00
.dockerignore fix: git information in health API response [TAB-177] (#375) 2023-08-29 18:19:54 +08:00
.gitattributes Add docker compose (#3) 2023-03-22 02:42:47 +08:00
.gitignore refactor: 💡 Add some .gitignore rules 2023-09-11 09:58:47 +08:00
.gitmodules refactor: use TabbyML/llama.cpp submodule 2023-09-03 12:38:54 +08:00
.rustfmt.toml refactor: rust nightly format (#197) 2023-06-05 14:17:07 -07:00
Cargo.lock feat: add support vertex-ai http bindings (#419) 2023-09-09 11:22:58 +00:00
Cargo.toml refactor: run make fix 2023-09-11 12:58:38 +08:00
Dockerfile fix: docker build hangs due to interactive tzdata 2023-09-08 10:23:57 +08:00
LICENSE Create LICENSE 2023-03-16 17:28:10 +08:00
Makefile feat: build index from dataset (#234) 2023-06-12 19:21:27 +00:00
README.md docs: Update README.md 2023-09-13 00:26:04 +08:00
package.json refactor(agent): agent http request and cancellation flow. (#446) 2023-09-15 11:05:46 +08:00
yarn.lock refactor(agent): agent http request and cancellation flow. (#446) 2023-09-15 11:05:46 +08:00

README.md

🐾 Tabby

build status Docker pulls License Slack Community

Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot. It boasts several key features:

  • Self-contained, with no need for a DBMS or cloud service.
  • OpenAPI interface, easy to integrate with existing infrastructure (e.g Cloud IDE).
  • Supports consumer-grade GPUs.

Open in Playground

Demo

👀 What's New

  • 09/12/2023 Apple's M1/M2 Metal inference support has landed in v0.1.0!
  • 08/31/2023 tabby's first stable release v0.0.1 🥳.
  • 08/28/2023 Experimental support for the CodeLlama 7B.
  • 08/24/2023 Tabby is now on JetBrains Marketplace!

👋 Getting Started

The easiest way to start a Tabby server is by using the following Docker command:

docker run -it \
  --gpus all -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby \
  serve --model TabbyML/SantaCoder-1B --device cuda

For additional options (e.g inference type, parallelism), please refer to the documentation at https://tabbyml.github.io/tabby.

🤝 Contributing

Get the Code

git clone --recurse-submodules https://github.com/TabbyML/tabby
cd tabby

Build

  1. Set up the Rust environment by following this tutorial.

  2. Install the required dependencies:

# For MacOS
brew install protobuf

# For Ubuntu / Debian
apt-get install protobuf-compiler libopenblas-dev
  1. Now, you can build Tabby by running the command cargo build.

Start Hacking!

... and don't forget to submit a Pull Request

🌟 Star History

Star History Chart