mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-03-04 15:16:03 -05:00
Code Issues Packages Projects Releases Wiki Activity

chore: revert back previous backend support PyTorch (#739)

Browse Source 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
This commit is contained in:
Aaron Pham
2023-11-29 01:44:41 -05:00
committed by GitHub
parent 0ce7782c2c
commit f0fa06004b
2 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
openllm-python/README.md generated
View File

@@ -1666,7 +1666,7 @@ it by specifying its URL:
```python
from langchain.llms import OpenLLM
llm = OpenLLM(server_url='http://44.23.123.1:3000', server_type='grpc')
llm = OpenLLM(server_url='http://44.23.123.1:3000', server_type='http')
llm('What is the difference between a duck and a goose? And why there are so many Goose in Canada?')
```

1
openllm-python/src/openllm_cli/entrypoint.py
View File

@@ -813,7 +813,6 @@ def build_command(
if backend == 'pt':
logger.warning("PyTorch backend is deprecated and will be removed from the next releases. Will set default backend to 'vllm' instead.")
backend = 'vllm'
llm = openllm.LLM[t.Any, t.Any](
model_id=model_id,