Repos tagged "openai-compatible"

Run large language models locally on your own machine with a simple CLI and OpenAI-compatible API.

A fast and memory-efficient LLM inference server with OpenAI-compatible API and PagedAttention.

A drop-in, self-hosted replacement for the OpenAI API that runs LLMs, image generation, and STT locally.