mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-29 18:01:53 -05:00
Code Issues Packages Projects Releases Wiki Activity

chore(infra): cleanup bashscript and respect .envrc [skip ci]

Browse Source 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
This commit is contained in:
Aaron Pham
2024-06-08 01:08:43 -04:00
parent 82449f42d3
commit 3c7362289a
6 changed files with 30 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
openllm-python/README.md generated
View File

@@ -773,8 +773,7 @@ OpenLLM is not just a standalone product; it's a building block designed to
integrate with other powerful tools easily. We currently offer integration with
[OpenAI's Compatible Endpoints](https://platform.openai.com/docs/api-reference/completions/object),
[LlamaIndex](https://www.llamaindex.ai/),
[LangChain](https://github.com/hwchase17/langchain), and
[Transformers Agents](https://huggingface.co/docs/transformers/transformers_agents).
[LangChain](https://github.com/hwchase17/langchain).
### OpenAI Compatible Endpoints
@@ -791,7 +790,7 @@ completions = client.chat.completions.create(
)
```
The compatible endpoints supports `/completions`, `/chat/completions`, and `/models`
The compatible endpoints supports `/chat/completions`, and `/models`
> [!NOTE]
> You can find out OpenAI example clients under the
@@ -806,7 +805,8 @@ from llama_index.llms.openllm import OpenLLMAPI
```
> [!NOTE]
> All synchronous and asynchronous API from `llama_index.llms.LLM` are supported.
> All synchronous and asynchronous API from `llama_index.llms.OpenLLMAPI` are supported.
> Make sure to install `llama-index-integrations-llm-openllm` to use the supported class.
### [LangChain](https://python.langchain.com/docs/integrations/llms/openllm/)