106 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Brendan Dolan-Gavitt	f9a4d4f528	Another try, fixing missing env vars	2022-11-23 20:49:41 -05:00
Brendan Dolan-Gavitt	2178d9e9de	Split out the container build	2022-11-23 18:27:20 -05:00
Brendan Dolan-Gavitt	d4c4a070e2	pull the images in a separate step so it doesn't take so long to build	2022-11-23 18:18:19 -05:00
Brendan Dolan-Gavitt	8e4b4e3d2e	debugging actions :(	2022-11-23 18:06:00 -05:00
Brendan Dolan-Gavitt	6519235223	fix indentation	2022-11-23 17:44:55 -05:00
Brendan Dolan-Gavitt	f599b2ec65	Basic action that runs pytest	2022-11-23 17:23:10 -05:00
Brendan Dolan-Gavitt	fd484a2b03	Merge branch 'python_backend' ... Add a couple commits from BDG to fix small issues.	2022-11-23 17:18:37 -05:00
Brendan Dolan-Gavitt	92dc571108	Merge pull request #86 from thakkarparth007/python_backend ... Add python backend support	2022-11-23 16:58:52 -05:00
Brendan Dolan-Gavitt	f84f040a58	remove spurious common_config and force a container build for the python backend	2022-11-23 16:58:30 -05:00
Brendan Dolan-Gavitt	7e8c74d3a6	s/docker-compose/docker compose/ and add requirements.txt	2022-11-23 16:57:16 -05:00
Parth	7ea388fe19	Fix segfault issue ... I'd been using dlpack for copying triton tensors to torch tensors, which I did because it was advertised to perform zero copy transfers. Turns out that only worked on my laptop, and didn't work on other machines. IDK why. But for now, I'm just copying the tensors as triton<->numpy<->torch. That works on the VM on which earlier code was segfaulting Signed-off-by: Parth <thakkarparth007@gmail.com>	2022-11-19 18:32:50 +00:00
Parth Thakkar	f0a12b5e8e	Merge branch 'main' into python_backend ... Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-11-09 12:51:16 -06:00
Parth Thakkar	fa423d1da1	Update location of hf_cache in case user doesn't want to share cache ... Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-11-08 17:57:43 -06:00
Brendan Dolan-Gavitt	e5825da8be	Very important update: add a logo	2022-11-02 17:25:37 -04:00
Brendan Dolan-Gavitt	00db26c3b7	Merge pull request #100 from Frederisk/patch-3 ... Add EditorConfig file	2022-11-01 19:58:25 +02:00
Brendan Dolan-Gavitt	f41c21a1fb	Merge pull request #92 from fdegier/patch-1 ... Add GitLab VS Code extension	2022-11-01 18:58:17 +02:00
Brendan Dolan-Gavitt	690e00467a	Merge pull request #93 from fdegier/feat/prompt-safety-valve ... feat: Return 400 for prompts that are too long	2022-11-01 18:49:19 +02:00
Brendan Dolan-Gavitt	b7b85461af	Reformat the error to match OpenAI's	2022-11-01 12:46:55 -04:00
Brendan Dolan-Gavitt	87900f4fa0	Merge pull request #101 from Frederisk/patch-4 ... Delete example.env	2022-10-31 22:00:43 +02:00
Rowe Wilson Frederisk Holme	65161c88e4	Delete example.env	2022-10-23 05:11:21 +08:00
Rowe Wilson Frederisk Holme	a2d6ec2215	Create .editorconfig	2022-10-23 05:03:33 +08:00
Parth Thakkar	b3bf26ba90	Merge branch 'moyix:main' into python_backend	2022-10-21 13:25:33 -05:00
Parth Thakkar	c6be12979e	Fix setup issues and add test script ... Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-10-21 13:23:10 -05:00
Brendan Dolan-Gavitt	ba76ccf74a	Merge pull request #96 from Frederisk/patch-1 ... Remove unused ignore rule	2022-10-21 14:18:38 -04:00
Fred de Gier	2a91018792	Resolve merge conflicts and fix issues with setup.sh	2022-10-20 16:09:12 +02:00
Fred de Gier	4f936c3049	Pep8 formatting	2022-10-20 15:37:17 +02:00
Fred de Gier	e2486698e0	feat: Return a 400 if prompt exceeds max tokens	2022-10-20 14:56:39 +02:00
Rowe Wilson Frederisk Holme	5367196e3f	Remove unused ignore rule	2022-10-20 17:25:46 +08:00
Brendan Dolan-Gavitt	31d2349dbb	Now that launch.sh runs in the background, add shutdown.sh to stop the server	2022-10-19 17:37:59 -04:00
Brendan Dolan-Gavitt	0fcd4fff50	Merge pull request #73 from fdegier/main ... Simplify config and port setup	2022-10-19 12:14:16 -04:00
Fred de Gier	986c342cad	Update launch.sh	2022-10-19 14:52:22 +02:00
Fred de Gier	43900971f2	Add GitLab VS Code extension	2022-10-19 14:37:06 +02:00
fdegier	d3180fd306	Implement code review suggestions	2022-10-19 14:19:37 +02:00
Parth Thakkar	01f1cbb629	Add python backend support ... - Modify dockerfile to include bitsandbytes, transformers and latest version of pytorch - Minor modifications in utils/codegen.py so that same client works with FT and Py-backend - Minor modifications in launch.sh (no need to name models by GPU) - Add installation script for adding a new python model (with super simple config_template) - Modify setup.sh so that it aworks with both FT and Python backend models Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>	2022-10-16 22:05:09 -05:00
Brendan Dolan-Gavitt	9b2bc84670	Merge pull request #79 from leemgs/patch-8 ... fix: fixed a typo in client.md file	2022-10-14 11:03:15 -04:00
Geunsik Lim	5b30643560	fix: fixed a typo in client.md file ... This commit is trivial. It is to fix a typo. Signed-off-by: Geunsik Lim <leemgs@gmail.com> Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>	2022-10-11 10:02:04 +09:00
Brendan Dolan-Gavitt	82e769e5fe	Merge pull request #77 from leemgs/upstream-documentation ... doc: Added documentation folder for readability and maintenance	2022-10-05 20:45:26 -04:00
Geunsik Lim	c02465d336	doc: Fixed a typo in the README.md file ... This commis is to apply the comment of @moyix. Signed-off-by: Geunsik Lim <leemgs@gmail.com> Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>	2022-10-05 17:35:12 +09:00
Geunsik Lim	d3c88dd50e	doc: Added documentation folder for readability and maintenance ... This commit is to append the documentation folder newly to maintain the README.md file with high-readability. It is because the file is a gateway of the FauxPilot project, let's simplify the contents of the README.md file ASAP. Signed-off-by: Geunsik Lim <leemgs@gmail.com> Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>	2022-10-04 14:56:43 +09:00
Fred de Gier	9a9c701bac	Merge pull request #6 from fdegier/dev ... Dev	2022-10-03 14:28:31 +02:00
Fred de Gier	de71bb6ff5	Resole merge conflicts	2022-10-03 14:27:32 +02:00
Fred de Gier	7408421b00	Merge pull request #5 from fdegier/dev ... Dev	2022-10-03 14:22:45 +02:00
Fred de Gier	ed1d877b7c	Simplify config	2022-10-03 14:20:58 +02:00
Fred de Gier	6739b7c53d	Merge branch 'main' into dev	2022-10-03 14:13:39 +02:00
Fred de Gier	87f4f53e27	Simplify config and port handling	2022-10-03 14:13:10 +02:00
Fred de Gier	6f49915d2a	Error handling	2022-10-03 11:47:54 +02:00
Brendan Dolan-Gavitt	12d2367a5a	Update README with more info ... - Link to the wiki and discussion forums - Add a paragraph mentioning the tokenizer issue with the official Copilot plugin. - Update the OpenAI example to match the current API ("engine" is now "model").	2022-09-30 22:18:31 -04:00
Brendan Dolan-Gavitt	79fa54008b	Fix launch.sh for case where docker path has a space ... Fixes #67	2022-09-30 22:03:19 -04:00
Brendan Dolan-Gavitt	33e8cac5b8	Merge pull request #64 from Frederisk/patch-3 ... Fixed bugs from #49 about wrong hostnames	2022-09-23 17:52:17 -04:00
Brendan Dolan-Gavitt	80857654a8	Merge pull request #65 from leemgs/patch-7 ... doc: added web link of Huggingface to be downloaded	2022-09-23 17:50:27 -04:00