# inference

> Browse 4 items tagged with inference.

## Items

- [FINGER — Fast Inference for Graph-based ANNS](https://vectordb.ever.works/items/finger-fast-inference-for-graph-based-anns) — FINGER provides a fast inference framework for graph-based approximate nearest neighbor search, optimizing search path traversal to reduce query latency while maintaining high recall. Published at Web 2023.
- [vLLM](https://vectordb.ever.works/items/vllm) — High-throughput and memory-efficient open-source LLM inference engine with PagedAttention, continuous batching, and support for embedding model serving. Widely adopted for production-scale AI inference.
- [NVIDIA NIM](https://vectordb.ever.works/items/nvidia-nim) — Accelerated inference microservices that allow organizations to run AI models on NVIDIA GPUs anywhere with optimized inference engines, industry-standard APIs, and runtime dependencies in enterprise-grade containers.
- [Xinference](https://vectordb.ever.works/items/xinference) — Open-source platform for serving LLMs, embedding models, and multimodal models with OpenAI-compatible APIs, distributed deployment, and automatic batching for scalable AI model inference.

---

_Canonical page: https://vectordb.ever.works/tags/inference_