From b8325bd8abb60e9ab6679429605643396f1091dc Mon Sep 17 00:00:00 2001 From: Meng Zhang Date: Wed, 15 Nov 2023 15:00:16 -0800 Subject: [PATCH] docs: polish faq part for custom model --- website/docs/faq.mdx | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/website/docs/faq.mdx b/website/docs/faq.mdx index eb1582a..3dc6ecb 100644 --- a/website/docs/faq.mdx +++ b/website/docs/faq.mdx @@ -31,7 +31,8 @@ import CodeBlock from '@theme/CodeBlock';
How can I convert my own model for use with Tabby?
-

Since version 0.5.0, Tabby's inference now operates entirely on llama.cpp, allowing the use of any GGUF-compatible model format with Tabby. To enhance accessibility, we have curated models that we benchmarked, available at https://github.com/TabbyML/registry-tabby. Users are free to fork the repository to create their own registry. If a user's registry is located at https://github.com/USERNAME/registry-tabby, the model ID will be `--model USERNAME/model`.

-

For details on the registry format, please refer to https://github.com/TabbyML/registry-tabby/blob/main/models.json

+

Since version 0.5.0, Tabby's inference now operates entirely on llama.cpp, allowing the use of any GGUF-compatible model format with Tabby. To enhance accessibility, we have curated models that we benchmarked, available at registry-tabby.

+

Users are free to fork the repository to create their own registry. If a user's registry is located at https://github.com/USERNAME/registry-tabby, the model ID will be USERNAME/model.

+

For details on the registry format, please refer to models.json