mirror of
https://github.com/fauxpilot/fauxpilot.git
synced 2025-08-21 13:54:29 -07:00
Mention curl and zstd requirement
This commit is contained in:
parent
9363bcd586
commit
ebbdb93204
1 changed files with 1 additions and 0 deletions
|
@ -10,6 +10,7 @@ You'll need:
|
||||||
* `docker-compose` >= 1.28
|
* `docker-compose` >= 1.28
|
||||||
* An NVIDIA GPU with enough VRAM to run the model you want.
|
* An NVIDIA GPU with enough VRAM to run the model you want.
|
||||||
* [`nvidia-docker`](https://github.com/NVIDIA/nvidia-docker)
|
* [`nvidia-docker`](https://github.com/NVIDIA/nvidia-docker)
|
||||||
|
* `curl` and `zstd` for downloading and unpacking the models.
|
||||||
|
|
||||||
Note that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU.
|
Note that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU.
|
||||||
|
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue