openllm 0.6.30

2026-05-07

Tags: #ai #category/operations #lang/python #llm #type/cli #type/daemon

Description

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud

Homepage

https://bentoml.com/

Repository

https://github.com/bentoml/OpenLLM

Install

uniget install openllm

Dependencies

Used by

Code

See code on GitLab

Package

See package on GitLab

Size

63305004

Platforms

  • linux/amd64

Changelog

DateMessageSHA
2026-05-07T21:06:03+02:00chore: Improved order of field in manifests4f5b4d2002
2026-05-07T20:58:14+02:00chore: Removed unused field from manifestsaa63f6f3b8
2025-09-10T09:17:39+02:00feat: Improved tags2e48aef6ac
2025-07-01T17:12:29+02:00feat(python): Use 3.12 by defaultfca34b5612
2025-05-20T15:24:30+02:00feat: Improved tags7184a2bf4b
2025-05-19T16:50:31+02:00feat(openllm): Added76461c7b12