Commit graph

154 commits

Author SHA1 Message Date
Brendan Dolan-Gavitt
788edd44f2 Add missing configs for 4gpu setups 2023-05-29 16:00:43 -04:00
Brendan Dolan-Gavitt
fb4073a907 Remove the issue autoreplier; just adds clutter 2023-04-27 00:22:12 -04:00
alekseiberezhnoi
32a3c76fd7
fix raise FauxPilotexception (#172) 2023-03-28 10:06:20 +02:00
Matt Williams
e2f5f32298
Its not actually github copilot, its an alternative. (#175) 2023-03-28 10:02:03 +02:00
Artur Rodrigues
770f56a658
Remove Gitlab VSCode Extension suggestion (#169)
It is no longer supported: https://gitlab.com/gitlab-org/gitlab-vscode-extension/-/merge_requests/697
2023-03-15 11:20:15 +01:00
Geunsik Lim
0e80eefb76
fix: fixed an incorreect if statement (#158)
Resolved #157.
The setup.sh generates the "integer expression expected" issue.
This commit is to fix this issue.

Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
2023-03-13 10:00:01 +01:00
Claudio Spiess
f9e7eff4ec
Fix arg (#151) 2023-02-21 19:18:54 +01:00
Fred de Gier
283668448d
Dev (#148)
* Create publish-docker-images.yaml

* Add copilot_proxy publishing

* Add model_converter publishing

* Use dockerhub version

* Do not login for PRs

* Overwrite some of labels value

* Move ignore files to the root of `context`

* Add comments & fix some issue

* Fix typos

* Remove the target of the master branch

* Delete .dockerignore

* Delete .dockerignore

* Add Flake8

* Add Flake8 and format code accordingly

* Iterate on the PR template, fix the token for the contributor action

* Remove converter image build

* Update Dockerfile of proxy

* Comment out proxy image in compose

Co-authored-by: Fred de Gier <freddegier@me.com>

* Fix build action

---------

Co-authored-by: Rowe Wilson Frederisk Holme <frederisk@outlook.com>
2023-02-15 09:17:07 +01:00
Fred de Gier
1bb0e53117
Merge pull request #145 from fauxpilot/dev
Dev
2023-02-14 11:45:15 +01:00
Parth Thakkar
6c1b7fb404
Merge pull request #137 from leemgs/upstream-python-backend-cc-type
fix: Disable INT8 as a default CC type in Python-backend to support CC 6.0+
2023-02-13 17:29:29 +00:00
fdegier
bd99831635 Resolve conflicts 2023-02-13 16:52:49 +01:00
Fred de Gier
50901eb55d
Merge pull request #80 from luanshaotong/main
modify build dir of copilot_proxy
2023-02-13 16:09:53 +01:00
Fred de Gier
7ebb56c551
Merge branch 'main' into main 2023-02-13 16:07:45 +01:00
fdegier
6ac8d0b081 Reduce docker build context size 2023-02-13 16:05:35 +01:00
Fred de Gier
9e60c2b644
Merge pull request #109 from leemgs/upstream-codereview-codeowners
github: added CODEOWNERS for automated review list
2023-02-13 15:28:07 +01:00
Fred de Gier
34bed8d087
Apply suggestions from code review 2023-02-13 15:27:56 +01:00
Fred de Gier
ee3bf35b79
Merge pull request #142 from petronny/vim-fix
Add fake copilot authentication to copilot proxy
2023-02-13 15:25:14 +01:00
Fred de Gier
9bc968da02
Apply suggestions from code review 2023-02-13 15:24:18 +01:00
Jingbei Li
0be814be58 add fake copilot authentication to copilot proxy 2023-01-31 16:41:51 +08:00
Jingbei Li
fe69980660 make copilot proxy compatible with official copilot plugins 2023-01-31 16:21:48 +08:00
Parth Thakkar
60674dbbd5
Merge pull request #141 from fauxpilot/docker-compose-fix
Fix docker compose invocation
2023-01-30 09:02:50 -06:00
Parth Thakkar
99e41d7005 Fix docker compose invocation
1. Make sure we don't call docker-compose if 'docker compose' is available
2. Automatically build the container (will be cached by docker, so no overhead) (fixes #140)

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2023-01-24 12:10:48 -06:00
Brendan Dolan-Gavitt
4441e5e16b small fixes to the triton config gen script 2023-01-11 20:43:18 -05:00
Parth Thakkar
64c478d826
Merge pull request #135 from fauxpilot/py-model-ergonomics
Some minor ergonomic changes for python backend
2023-01-11 12:21:36 +05:30
Geunsik Lim
b4d9865d84 Added reviewers to encourage review procedure
Signed-off-by: Geunsik Lim <leemgs@gmail.com>
2023-01-04 09:11:55 +09:00
Parth Thakkar
58e2ac9673
Merge pull request #136 from leemgs/upstream-setup-docker
fix: improved the docker compose statement to handle various docker env
2023-01-03 16:48:53 +05:30
Geunsik Lim
1ecd68aeb1 fix: enabled !INT8 as a default CC type in the Python-backend
CC (Compute Capability) of Nvidia GPU supports INT8 from version 9.0.
Therefore, this patch is to change the default SM (Streaming Machine) type to INT8
so that stable operation is compatible with versions between CC 6.0 and CC 9.0.

* Prerequisites: An NVIDIA GPU with Compute Capability >= 6.0
  https://github.com/fauxpilot/fauxpilot#prerequisites

* Architecture of Compute Capability (CC)9.0
  https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#id100

Signed-off-by: Geunsik Lim <leemgs@gmail.com>
2023-01-03 14:51:16 +09:00
Geunsik Lim
c2caa897c2 fix: improved the docker compose statement to handle various docker env
This commit is to handle both "docker-compose" and "docker compose"
environment while running the python_backend function in the setup.sh.

Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsuang.com>
2023-01-03 11:28:34 +09:00
Parth Thakkar
4bf40cdb6c Some minor ergonomic changes for python backend
- Add validation rule to ensure  is set to fastertransformer or python-backend
- Add warning if model is unavailable, likely the user has not set  correctly

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2023-01-02 18:54:51 +05:30
Fred de Gier
8df5058c5c
Merge pull request #111 from leemgs/upstream-pr-template
github: added PULL_REQEUEST_TEMPLATE for PR maintenance
2023-01-02 11:04:44 +01:00
Geunsik Lim
2d9367ae45 GitHub: added PULL_REQEUEST_TEMPLATE for PR maintenance
This commit is to improve PR template (e.g., summary, goal, description,
reproduction, and so on) that can be submitted by contributers
to evolve the FauxPilot software.

**Changelog**
 * Version 2
  - Applied comments of reviewer(s)
  - Updated the sections of a PR writing guide for readability.

 * Version 1
  - Added Pull Request template

Signed-off-by: Geunsik Lim <leemgs@gmail.com>
Signed-off-by: Geunsik Lim <geunsik.lim@samsung.com>
2023-01-02 15:25:35 +09:00
Brendan Dolan-Gavitt
e18fbf5145
Merge pull request #131 from fauxpilot/fix-streaming
Fix json formatting issue with streaming
2022-12-24 17:54:12 -05:00
Parth Thakkar
e90f1c5dc2 Discard extra newlines
Doesn't seem necessary. Copilot works without these newlines

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-12-24 02:58:31 +05:30
Parth Thakkar
566cf7a675 Fix json formatting issue with streaming
See this and the following comment for context:

https://github.com/fauxpilot/fauxpilot/issues/1\#issuecomment-1357174072

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-12-24 02:50:06 +05:30
Fred de Gier
7ebe8b6d5b
Merge pull request #112 from leemgs/upstream-action-new-contributor
github: added action runner to welcome  new contributors
2022-12-22 19:55:14 +01:00
Fred de Gier
0642015c80
Merge pull request #110 from leemgs/upstream-issue-template
github: added ISSUE_TEMPLATE for issue maintenance
2022-12-22 19:34:32 +01:00
Brendan Dolan-Gavitt
ecc47dbf96
Merge pull request #105 from leemgs/upstream-unknow-flag-removal
feat: add option of launch.sh to avoid unknown flags issue
2022-12-20 17:57:11 -05:00
Brendan Dolan-Gavitt
df15a58544 Small fixes to launch.sh option parsing
* Fixed a small mistake that prevented the -h option from working.
* Corrected some capitalization / grammar issues in the help text.
* Removed a debug print that was left in.
2022-12-20 17:28:28 -05:00
Brendan Dolan-Gavitt
8c0a257017
Merge pull request #126 from Frederisk/patch-3
Ignore huggingface cache
2022-11-26 18:40:57 -06:00
Rowe Wilson Frederisk Holme
e09c0030b7
Update .dockerignore 2022-11-26 22:14:50 +08:00
Rowe Wilson Frederisk Holme
bc26fb453e
Ignore huggingface cache 2022-11-26 22:14:02 +08:00
Brendan Dolan-Gavitt
3960f31bcb
Merge pull request #115 from leemgs/upstream-converter-doc
doc: Added manual on converter script files
2022-11-24 17:04:42 -05:00
Brendan Dolan-Gavitt
5b024b9b3b
Merge pull request #108 from leemgs/upstream-logo
doc: added logo image of FauxPilot
2022-11-24 16:41:40 -05:00
Brendan Dolan-Gavitt
c0010cd5d2
Merge pull request #125 from Frederisk/patch-1
Fix #119
2022-11-24 15:45:56 -05:00
Brendan Dolan-Gavitt
e153c17194 Fix bug introduced by Python backend merge
HF_CACHE_DIR needs to be set in .env, even if the FT backend is in
use, or docker compose will complain and fail to start.
2022-11-24 15:44:15 -05:00
Rowe Wilson Frederisk Holme
ed0695ce3a
Fix #119 2022-11-25 00:19:22 +08:00
Brendan Dolan-Gavitt
1b2b8ec251
Add basic CI that tests the Python backend (#124)
* Basic action that runs pytest

* fix indentation

* debugging actions :(

* pull the images in a separate step so it doesn't take so long to build

* Split out the container build

* Another try, fixing missing env vars
2022-11-23 21:01:29 -05:00
Brendan Dolan-Gavitt
fd484a2b03 Merge branch 'python_backend'
Add a couple commits from BDG to fix small issues.
2022-11-23 17:18:37 -05:00
Brendan Dolan-Gavitt
92dc571108
Merge pull request #86 from thakkarparth007/python_backend
Add python backend support
2022-11-23 16:58:52 -05:00
Brendan Dolan-Gavitt
f84f040a58 remove spurious common_config and force a container build for the python backend 2022-11-23 16:58:30 -05:00