Git Repository Guide

Tag

Repos tagged "serving"

1 repository

vLLM

AI/ML Self-hostable

vLLM

A fast and memory-efficient LLM inference server with OpenAI-compatible API and PagedAttention.