diff --git a/website/docs/03-faq.md b/website/docs/03-faq.mdx similarity index 60% rename from website/docs/03-faq.md rename to website/docs/03-faq.mdx index ed2d2ff..682abb3 100644 --- a/website/docs/03-faq.md +++ b/website/docs/03-faq.mdx @@ -1,3 +1,5 @@ +import CodeBlock from '@theme/CodeBlock'; + # ⁉️ Frequently Asked Questions
@@ -18,3 +20,14 @@

+ +
+ How to utilize multiple NVIDIA GPUs? +
+

Tabby supports replicating models on multiple GPUs to increase throughput. You can specify the devices for model replication by using the --device-indices option.

+ + # Replicate model to GPU 0 and GPU 1.{'\n'} + tabby serve ... --device-indices 0 --device-indices 1 + +
+