# About

OpenLLM was started at [BentoML](https://bentoml.com) to provide a simple
and easy to use interface for serving and deploying large language models (LLMs)
in production. With OpenLLM, you can run inference with any open-source LLMs, deploy models to the
cloud or on-premises, and build powerful AI applications. It supports a wide range of open-source LLMs and
offers flexible APIs with first-class support for BentoML and LangChain.

## Team

The project is currently maintained by [Aaron Pham](https://twitter.com/aarnphm_). You can check out
the full list of contributors on [GitHub](https://github.com/bentoml/OpenLLM/graphs/contributors).

## Credits

OpenLLM is powered by these incredible open-source projects:

- https://bentoml.com/
- https://huggingface.co/docs/transformers/index
- https://github.com/PanQiWei/AutoGPTQ
- https://github.com/huggingface/peft

The documentation is powered by [Nextra](https://nextra.site/).

## Design assets

Feel free to use any of the assets in your project. But please modify
the logo and don't use these logo to represent your product or project.

|    Name     |                   Description                    |                Preview                |
| :---------: | :----------------------------------------------: | :-----------------------------------: |
|    Icon     | Useful for favicons, app icons, link icons, etc. | ![OpenLLM icon](/favicon/favicon.svg) |
|    Logo     |                Full OpenLLM logo                 |      ![OpenLLM logo](/logo.svg)       |
| Social Card |             The OpenLLM social card              |       ![OpenLLM card](/og.png)        |

## License

The OpenLLM project is licensed under the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0)