fix: ensure correct version of torch is always installed based on BUILD_TYPE(#2890)

* fix: ensure correct version of torch is always installed based on BUILD_TYPE

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* Move causal-conv1d installation to build_types

Signed-off-by: mudler <mudler@localai.io>

* Move mamba-ssd install to build-type requirements.txt

Signed-off-by: mudler <mudler@localai.io>

---------

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
Signed-off-by: mudler <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: mudler <mudler@localai.io>

backend/python/diffusers/requirements-cublas11.txt

@@ -0,0 +1,2 @@
+--extra-index-url https://download.pytorch.org/whl/cu118
+torch

backend/python/diffusers/requirements-cublas12.txt

@@ -0,0 +1 @@
+torch

backend/python/diffusers/requirements.txt

@@ -8,6 +8,5 @@ opencv-python
 pillow
 protobuf
 sentencepiece
-torch
 transformers
 certifi