Aaron Pham 8d63afc9ce feat(vllm): support GPTQ with 0.2.6 (#797) ...

* feat(vllm): GPTQ support passthrough

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: run scripts

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* fix(install): set order of xformers before vllm

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* feat: support GPTQ with vLLM

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

2023-12-18 12:41:19 -05:00

..

openllm

feat(vllm): support GPTQ with 0.2.6 (#797)

2023-12-18 12:41:19 -05:00

openllm_cli

fix(cli): avoid runtime __origin__ check for older Python (#798)

2023-12-18 12:33:36 -05:00