diff --git a/website/docs/faq.mdx b/website/docs/faq.mdx index 3425c37..089a613 100644 --- a/website/docs/faq.mdx +++ b/website/docs/faq.mdx @@ -24,11 +24,7 @@ import CodeBlock from '@theme/CodeBlock';
How to utilize multiple NVIDIA GPUs?
-

Tabby supports replicating models on multiple GPUs to increase throughput. You can specify the devices for model replication by using the --device-indices option.

- - # Replicate model to GPU 0 and GPU 1.{'\n'} - tabby serve ... --device-indices 0 --device-indices 1 - +

Tabby only supports the use of a single GPU. To utilize multiple GPUs, you can initiate multiple Tabby instances and set CUDA_VISIBLE_DEVICES accordingly.

@@ -38,4 +34,4 @@ import CodeBlock from '@theme/CodeBlock';

Follow the instructions provided in the Model Spec.

Please note that the spec is unstable and does not adhere to semver.

- \ No newline at end of file +