mirror of
https://github.com/bentoml/OpenLLM.git
synced 2026-01-25 07:47:49 -05:00
fddd0bf95e
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com> Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com> Signed-off-by: GutZuFusss <leon.ikinger@googlemail.com> Co-authored-by: GutZuFusss <leon.ikinger@googlemail.com>
39 lines
1.7 KiB
Plaintext
39 lines
1.7 KiB
Plaintext
# About
|
|
|
|
OpenLLM was started at [BentoML](https://bentoml.com) to provide a simple
|
|
and easy to use interface for serving and deploying large language models (LLMs)
|
|
in production. With OpenLLM, you can run inference with any open-source LLMs, deploy models to the
|
|
cloud or on-premises, and build powerful AI applications. It supports a wide range of open-source LLMs and
|
|
offers flexible APIs with first-class support for BentoML and LangChain.
|
|
|
|
## Team
|
|
|
|
The project is currently maintained by [Aaron Pham](https://twitter.com/aarnphm_). You can check out
|
|
the full list of contributors on [GitHub](https://github.com/bentoml/OpenLLM/graphs/contributors).
|
|
|
|
## Credits
|
|
|
|
OpenLLM is powered by these incredible open-source projects:
|
|
|
|
- https://bentoml.com/
|
|
- https://huggingface.co/docs/transformers/index
|
|
- https://github.com/PanQiWei/AutoGPTQ
|
|
- https://github.com/huggingface/peft
|
|
|
|
The documentation is powered by [Nextra](https://nextra.site/).
|
|
|
|
## Design assets
|
|
|
|
Feel free to use any of the assets in your project. But please modify
|
|
the logo and don't use these logo to represent your product or project.
|
|
|
|
| Name | Description | Preview |
|
|
| :---------: | :----------------------------------------------: | :-----------------------------------: |
|
|
| Icon | Useful for favicons, app icons, link icons, etc. |  |
|
|
| Logo | Full OpenLLM logo |  |
|
|
| Social Card | The OpenLLM social card |  |
|
|
|
|
## License
|
|
|
|
The OpenLLM project is licensed under the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|