aarnphm-ec2-dev 8173cb09a5 fix(quantize): dyn quant for int8 and int4 ...

only set tokenizer when it is gptq

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

2023-09-07 01:48:45 +00:00

..

openllm

fix(quantize): dyn quant for int8 and int4

2023-09-07 01:48:45 +00:00