# observability

> Browse 17 items tagged with observability.

## Items

- [Galileo](https://vectordb.ever.works/items/galileo) — An AI observability and evaluation platform that helps monitor and evaluate LLM outputs, RAG pipelines, and data quality, with tools for detecting hallucinations and measuring retrieval quality.
- [RAGOps: Operating and Managing Retrieval-Augmented Generation Pipelines](https://vectordb.ever.works/items/ragops-operating-and-managing-retrieval-augmented-generation-pipelines) — Research paper on operating and managing Retrieval-Augmented Generation (RAG) pipelines at scale, covering production infrastructure patterns, monitoring, microservices decomposition, and multi-model architecture for enterprise embedding systems.
- [OpenLLMetry](https://vectordb.ever.works/items/openllmetry) — Open-source observability for GenAI and LLM applications based on OpenTelemetry, providing AI-aware instrumentation for vector databases, LLM frameworks, and model providers.
- [W&B Weave](https://vectordb.ever.works/items/wandb-weave) — LLM observability platform from Weights & Biases that automatically tracks all LLM calls, evaluations, and experiments with support for prompt engineering and vector store integration.
- [TruLens](https://vectordb.ever.works/items/trulens-llm-evaluation) — An evaluation framework for LLM applications including RAG systems, providing observability, debugging, and guardrails. TruLens tracks retrieval quality, LLM performance, and hallucinations with detailed tracing.
- [Quickwit](https://vectordb.ever.works/items/quickwit) — Cloud-native search engine for observability built on Tantivy, offering sub-second search on data stored in object storage as an open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
- [Vector Database Observability](https://vectordb.ever.works/items/vector-database-observability) — Comprehensive guide to monitoring vector databases including key metrics, logging strategies, tracing, alerting, and debugging techniques for production vector search systems.
- [Opik](https://vectordb.ever.works/items/opik) — An open-source LLM observability and evaluation platform that provides comprehensive tracking, monitoring, and evaluation capabilities for large language model applications. Designed for production AI systems with focus on debugging and performance optimization.
- [LangSmith](https://vectordb.ever.works/items/langsmith) — Production-grade observability and evaluation platform for LLM applications from LangChain, providing tracing, debugging, prompt evaluation, and performance monitoring for reliable LLM workflows in development and production.
- [TruLens](https://vectordb.ever.works/items/trulens) — Open-source evaluation and tracing library for AI agents and RAG systems, combining OpenTelemetry-based tracing with trustworthy evaluations including ground truth metrics and LLM-as-a-Judge feedback for production monitoring.
- [Arize Phoenix](https://vectordb.ever.works/items/arize-phoenix) — Open-source LLM tracing and evaluation solution built on OpenTelemetry for RAG evaluation. Provides automated instrumentation which records the execution path of LLM requests through multiple steps.
- [Helicone](https://vectordb.ever.works/items/helicone) — Open-source observability layer designed to help developers monitor and understand how their applications interact with large language models. Acts as a lightweight proxy between applications and LLM providers.
- [Portkey](https://vectordb.ever.works/items/portkey) — AI gateway that provides a unified interface to interact with 250+ AI models, offering advanced tools for control, visibility, and security in Generative AI applications. Integrates with vector databases for production-level routing and reliability.
- [Datadog Vector Database Monitoring](https://vectordb.ever.works/items/datadog-vector-database-monitoring) — Comprehensive observability solution for vector databases through Zilliz Cloud integration, providing metrics for QPS, latency, slow queries, and failure rates alongside full stack monitoring.
- [Monte Carlo Vector Database Observability](https://vectordb.ever.works/items/monte-carlo-vector-database-observability) — Data observability platform specifically supporting vector databases including Pinecone, providing comprehensive monitoring across the five pillars of data observability.
- [Langfuse](https://vectordb.ever.works/items/langfuse) — Open-source LLM engineering platform providing observability, metrics, evaluations, and prompt management. Integrates with OpenTelemetry, LangChain, OpenAI SDK, and vector databases for RAG pipeline monitoring.
- [Langtrace](https://vectordb.ever.works/items/langtrace) — Open-source LLM observability tool built on OpenTelemetry standards. Automatically captures traces from LLM APIs, vector databases, and frameworks with support for over 30 popular providers.

---

_Canonical page: https://vectordb.ever.works/tags/observability_