github/fauxpilot
1
0
Fork 0
mirror of https://github.com/fauxpilot/fauxpilot.git synced 2025-08-21 13:54:29 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #5 from akay/patch-1

Browse source 
add nvidia-docker to the list of prerequisites
This commit is contained in:
Brendan Dolan-Gavitt 2022-08-03 21:23:33 -04:00 • committed by GitHub
commit 958ee6f036
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
README.md
View file

@ -9,6 +9,7 @@ You'll need:
* Docker * Docker
* `docker-compose` >= 1.28 * `docker-compose` >= 1.28
* An NVIDIA GPU with enough VRAM to run the model you want. * An NVIDIA GPU with enough VRAM to run the model you want.
* [`nvidia-docker`](https://github.com/NVIDIA/nvidia-docker)
Note that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU. Note that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU.