Description

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud

Homepage

https://bentoml.com/

Repository

https://github.com/bentoml/OpenLLM

Install

`uniget install openllm`

Dependencies

• python

Code

See code on GitLab

Package

See package on GitLab

Size

56952832

Platforms

• linux/amd64

Changelog (last 10)