Open-source platform for serving LLMs, embedding models, and multimodal models with OpenAI-compatible APIs, distributed deployment, and automatic batching for scalable AI model inference.
लोड हो रहा है......
इस पृष्ठ पर
Xinference
Xinference (Xorbits Inference) is a powerful platform designed to serve language, speech recognition, and multimodal models. It enables running inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on-premises.
XorbitsAI builds production-ready infrastructure for:
इससे संबंधित और आइटम देखें