fauxpilot/python_backend
Parth Thakkar 01f1cbb629 Add python backend support
- Modify dockerfile to include bitsandbytes, transformers and latest version of pytorch
- Minor modifications in utils/codegen.py so that same client works with FT and Py-backend
- Minor modifications in launch.sh (no need to name models by GPU)
- Add installation script for adding a new python model (with super simple config_template)
- Modify setup.sh so that it aworks with both FT and Python backend models

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-10-16 22:05:09 -05:00
..
config_template.pbtxt Add python backend support 2022-10-16 22:05:09 -05:00
init_model.py Add python backend support 2022-10-16 22:05:09 -05:00
model.py Add python backend support 2022-10-16 22:05:09 -05:00