root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
925 Commits
39 Branches
72 Tags
22 MiB
Rust 73.6%
Python 20.6%
C++ 3.1%
Shell 0.7%
Dockerfile 0.6%
Other 1.4%
 
 
 
 
 
 
Go to file
Meng Zhang 8ab35b2639
feat: add --parallelism to control throughput and vram usage (#727) 
* feat: add --parallelism to control throughput and vram usage

* update default

* Revert "update default"

This reverts commit 349792c0d48d913dcd8be4ce1c9d7ce887918f29.

* cargo fmt
 		2023-11-08 18:31:22 +00:00
.github chore: change default bug label to be bug-unconfirmed 2023-11-07 08:59:54 -08:00
ci
…
clients fix(intellij): fix agent IO charset to UTF8. (#723) 2023-11-07 23:08:00 -08:00
contrib/jetson feat: add contrib/jetson/Dockerfilefor NVIDIA Jetson devices (#632) 2023-10-25 00:09:08 -07:00
crates feat: add --parallelism to control throughput and vram usage (#727) 2023-11-08 18:31:22 +00:00
ee feat: adding an auto completion component in chat playground (#702) 2023-11-07 13:29:07 -08:00
experimental feat: add an experimental supervisor (#630) 2023-10-27 12:46:08 -07:00
python/tabby
…
tests chore: update loadtest based on 0.5.0-rc.4 2023-11-03 17:59:55 -07:00
website feat: supports java (#715) 2023-11-07 23:59:00 -08:00
.dockerignore
…
.gitattributes docs: Update .gitattributes 2023-11-07 18:57:55 -08:00
.gitignore feat(experimental): use modal for easier evaluation. (#594) 2023-10-18 23:33:27 -07:00
.gitmodules refactor: use llama.cpp tokenizer (#683) 2023-10-31 22:16:09 +00:00
.rustfmt.toml
…
CHANGELOG.md docs: add v0.5.4 to changelog 2023-11-07 13:27:52 -08:00
Cargo.lock feat: supports java (#715) 2023-11-07 23:59:00 -08:00
Cargo.toml chore: add machete check to ensure no unused dependencies (#701) 2023-11-05 02:48:05 +00:00
Dockerfile fix: Update Dockerfile 2023-10-27 16:11:10 -07:00
LICENSE docs: remove boilerplate section 2023-10-29 16:21:53 -07:00
MODEL_SPEC.md docs: fix warning sign in MODEL_SPEC.md 2023-11-06 11:22:43 -08:00
Makefile chore: move tabby-ui under ee license. (#667) 2023-10-29 15:56:57 -07:00
README.md docs(README.md): add 0.5.4 to what's new 2023-11-07 13:44:08 -08:00
package.json refactor(agent): agent http request and cancellation flow. (#446) 2023-09-15 11:05:46 +08:00
yarn.lock refactor(agent): refactor completion postprocess and caching. (#576) 2023-10-17 09:04:04 -07:00

README.md

🐾 Tabby

latest release PRs Welcome Docker pulls

Slack Community Office Hours

Tabby is a self-hosted AI coding assistant, offering an open-source and on-premises alternative to GitHub Copilot. It boasts several key features:

  • Self-contained, with no need for a DBMS or cloud service.
  • OpenAPI interface, easy to integrate with existing infrastructure (e.g Cloud IDE).
  • Supports consumer-grade GPUs.

Open in Playground

Demo

🔥 What's New

  • 11/07/2023 v0.5.3 v0.5.4 released! With a redesign of UI + performance improvement.
  • 10/24/2023 ⛳️ Major updates for Tabby IDE plugins across VSCode/Vim/IntelliJ!
  • 10/15/2023 RAG-based code completion is enabled by detail in v0.3.0🎉! Check out the blogpost explaining how Tabby utilizes repo-level context to get even smarter!
Archived
  • 10/04/2023 Check out the model directory for the latest models supported by Tabby.
  • 09/18/2023 Apple's M1/M2 Metal inference support has landed in v0.1.1!
  • 08/31/2023 Tabby's first stable release v0.0.1 🥳.
  • 08/28/2023 Experimental support for the CodeLlama 7B.
  • 08/24/2023 Tabby is now on JetBrains Marketplace!

👋 Getting Started

You can find our documentation here.

Run Tabby in 1 Minute

The easiest way to start a Tabby server is by using the following Docker command:

docker run -it \
  --gpus all -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby \
  serve --model TabbyML/SantaCoder-1B --device cuda

For additional options (e.g inference type, parallelism), please refer to the documentation page.

🤝 Contributing

Get the Code

git clone --recurse-submodules https://github.com/TabbyML/tabby
cd tabby

If you have already cloned the repository, you could run the git submodule update --recursive --init command to fetch all submodules.

Build

  1. Set up the Rust environment by following this tutorial.

  2. Install the required dependencies:

# For MacOS
brew install protobuf

# For Ubuntu / Debian
apt-get install protobuf-compiler libopenblas-dev
  1. Now, you can build Tabby by running the command cargo build.

Start Hacking!

... and don't forget to submit a Pull Request

🌍 Community

  • #️⃣ Slack - connect with the TabbyML community
  • 🎤 Twitter / X - engage with TabbyML for all things possible
  • 📚 LinkedIn - follow for the latest from the community
  • 💌 Newsletter - subscribe to unlock Tabby insights and secrets

🌟 Star History

Star History Chart