Commit graph

2 commits

Author SHA1 Message Date
Parth Thakkar
01f1cbb629 Add python backend support
- Modify dockerfile to include bitsandbytes, transformers and latest version of pytorch
- Minor modifications in utils/codegen.py so that same client works with FT and Py-backend
- Minor modifications in launch.sh (no need to name models by GPU)
- Add installation script for adding a new python model (with super simple config_template)
- Modify setup.sh so that it aworks with both FT and Python backend models

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-10-16 22:05:09 -05:00
Fred de Gier
8895b74238 Rewrite API to FastAPI, separate API from CodeGen, remove dev settings 2022-09-12 12:59:37 +02:00