Ettore Di Giacinto
8b889955b4
chore(deps): bump pytorch to 2.7 in vllm ( #5576 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2025-06-04 08:56:45 +02:00
Ettore Di Giacinto
5ffad3b004
chore(deps): remove pin on transformers ( #5501 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2025-05-27 09:24:27 +02:00
Ettore Di Giacinto
6a382a1afe
fix(transformers): try to pin to working release ( #5426 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2025-05-22 12:50:51 +02:00
Ettore Di Giacinto
3e77a17b26
fix(dependencies): pin pytorch version ( #3872 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-10-18 09:11:59 +02:00
Ettore Di Giacinto
2553de0187
feat(vllm): add support for image-to-text and video-to-text ( #3729 )
...
* feat(vllm): add support for image-to-text
Related to https://github.com/mudler/LocalAI/issues/3670
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(vllm): add support for video-to-text
Closes: https://github.com/mudler/LocalAI/issues/2318
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(vllm): support CPU installations
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* feat(vllm): add bnb
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* chore: add docs reference
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Apply suggestions from code review
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2024-10-04 23:42:05 +02:00
Ettore Di Giacinto
2c8623dbb4
fix(python): move vllm to after deps, drop diffusers main deps
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-07 23:34:37 +02:00
Ettore Di Giacinto
61b5602111
fix(python): move accelerate and GPU-specific libs to build-type ( #3194 )
...
Some of the dependencies in `requirements.txt`, even if generic, pulls
down the line CUDA libraries.
This changes moves mostly all GPU-specific libs to the build-type, and
tries a safer approach. In `requirements.txt` now are listed only
"first-level" dependencies, for instance, grpc, but libs-dependencies
are moved down to the respective build-type `requirements.txt` to avoid
any mixin.
This should fix #2737 and #1592 .
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-08-07 17:02:32 +02:00
cryptk
ed322bf59f
fix: ensure correct version of torch is always installed based on BUILD_TYPE( #2890 )
...
* fix: ensure correct version of torch is always installed based on BUILD_TYPE
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
* Move causal-conv1d installation to build_types
Signed-off-by: mudler <mudler@localai.io >
* Move mamba-ssd install to build-type requirements.txt
Signed-off-by: mudler <mudler@localai.io >
---------
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com >
Signed-off-by: mudler <mudler@localai.io >
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
Co-authored-by: mudler <mudler@localai.io >
2024-08-05 16:38:33 +00:00
