root
/
tabby
mirror of https://gitee.com/zhang_1334717033/tabby.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

docs: polish faq part for custom model

release-fix-intellij-update-support-version-range
Meng Zhang 2023-11-15 15:00:16 -08:00
parent c0a4309061
commit b8325bd8ab
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
website/docs/faq.mdx vendored
View File

@ -31,7 +31,8 @@ import CodeBlock from '@theme/CodeBlock';
<details>
<summary>How can I convert my own model for use with Tabby?</summary>
<div>
<p>Since version 0.5.0, Tabby's inference now operates entirely on llama.cpp, allowing the use of any GGUF-compatible model format with Tabby. To enhance accessibility, we have curated models that we benchmarked, available at https://github.com/TabbyML/registry-tabby. Users are free to fork the repository to create their own registry. If a user's registry is located at https://github.com/USERNAME/registry-tabby, the model ID will be `--model USERNAME/model`.</p>
<p>For details on the registry format, please refer to https://github.com/TabbyML/registry-tabby/blob/main/models.json</p>
<p>Since version 0.5.0, Tabby's inference now operates entirely on llama.cpp, allowing the use of any GGUF-compatible model format with Tabby. To enhance accessibility, we have curated models that we benchmarked, available at <a href="https://github.com/TabbyML/registry-tabby">registry-tabby</a>.</p>
<p>Users are free to fork the repository to create their own registry. If a user's registry is located at <code>https://github.com/USERNAME/registry-tabby</code>, the model ID will be <code>USERNAME/model</code>.</p>
<p>For details on the registry format, please refer to <a href="https://github.com/TabbyML/registry-tabby/blob/main/models.json">models.json</a></p>
</div>
</details>