github/fauxpilot
1
0
Fork 0
mirror of https://github.com/fauxpilot/fauxpilot.git synced 2025-08-21 05:44:09 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #115 from leemgs/upstream-converter-doc

Browse source 
doc: Added manual on converter script files
This commit is contained in:
Brendan Dolan-Gavitt 2022-11-24 17:04:42 -05:00 • committed by GitHub
commit 3960f31bcb
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
converter/README.md Normal file
View file

@ -0,0 +1,9 @@
This section describes the Python scripts necessary for converting deep learning model files:
* `Dockerfile`: A Docker file used to construct an image based on Ubuntu 20.04 that includes the Transformer library.
* `download_and_convert_model.sh`: A shell script that converts model codegen-6B-multi with the provided number of GPUs.
* `codegen_gptj_convert.py`: A Python script for converting SalesForce CodeGen models to GPT-J (e.g., Salesforce/codegen-350M-multi).
* `huggingface_gptj_convert.py`: A Python script for converting the HF model to the GPT-J format (e.g., GPTJForCausalLM model)
* `triton_config_gen.py`: A Python script that creates a config and weight file for running a Codgen model with Triton.
* `config_template.pbtxt`: A template file for defining the config file's data format.