Commit graph

9 commits

Author SHA1 Message Date
Fred de Gier
283668448d
Dev (#148)
* Create publish-docker-images.yaml

* Add copilot_proxy publishing

* Add model_converter publishing

* Use dockerhub version

* Do not login for PRs

* Overwrite some of labels value

* Move ignore files to the root of `context`

* Add comments & fix some issue

* Fix typos

* Remove the target of the master branch

* Delete .dockerignore

* Delete .dockerignore

* Add Flake8

* Add Flake8 and format code accordingly

* Iterate on the PR template, fix the token for the contributor action

* Remove converter image build

* Update Dockerfile of proxy

* Comment out proxy image in compose

Co-authored-by: Fred de Gier <freddegier@me.com>

* Fix build action

---------

Co-authored-by: Rowe Wilson Frederisk Holme <frederisk@outlook.com>
2023-02-15 09:17:07 +01:00
fdegier
bd99831635 Resolve conflicts 2023-02-13 16:52:49 +01:00
fdegier
6ac8d0b081 Reduce docker build context size 2023-02-13 16:05:35 +01:00
Parth Thakkar
4bf40cdb6c Some minor ergonomic changes for python backend
- Add validation rule to ensure  is set to fastertransformer or python-backend
- Add warning if model is unavailable, likely the user has not set  correctly

Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2023-01-02 18:54:51 +05:30
Brendan Dolan-Gavitt
1b2b8ec251
Add basic CI that tests the Python backend (#124)
* Basic action that runs pytest

* fix indentation

* debugging actions :(

* pull the images in a separate step so it doesn't take so long to build

* Split out the container build

* Another try, fixing missing env vars
2022-11-23 21:01:29 -05:00
Brendan Dolan-Gavitt
7e8c74d3a6 s/docker-compose/docker compose/ and add requirements.txt 2022-11-23 16:57:16 -05:00
Parth
7ea388fe19 Fix segfault issue
I'd been using dlpack for copying triton tensors to torch tensors,
which I did because it was advertised to perform zero copy transfers.
Turns out that only worked on my laptop, and didn't work on other machines.
IDK why. But for now, I'm just copying the tensors as triton<->numpy<->torch.
That works on the VM on which earlier code was segfaulting

Signed-off-by: Parth <thakkarparth007@gmail.com>
2022-11-19 18:32:50 +00:00
Parth Thakkar
f0a12b5e8e Merge branch 'main' into python_backend
Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-11-09 12:51:16 -06:00
Parth Thakkar
c6be12979e Fix setup issues and add test script
Signed-off-by: Parth Thakkar <thakkarparth007@gmail.com>
2022-10-21 13:23:10 -05:00