LLM Observability Articles

Elevate LLM Observability with GCP Vertex AI Integration
GenAIGoogle CloudLLM Observability

Elevate LLM Observability with GCP Vertex AI Integration

Enhance LLM observability with Elastic's GCP Vertex AI Integration — gain actionable insights into model performance, resource efficiency, and operational reliability.

Ishleen Kaur

Muthukumar Paramasivam

Daniela Tzvetkova

LLM Observability with the new Amazon Bedrock Integration in Elastic Observability
AWSGenAILLM Observability

LLM Observability with the new Amazon Bedrock Integration in Elastic Observability

Elastic's new Amazon Bedrock integration for Observability provides comprehensive insights into Amazon Bedrock LLM performance and usage. Learn about how LLM based metric and log collection in real-time with pre-built dashboards can effectively monitor and resolve LLM invocation errors and performance challenges.

Agi K Thomas

Observing Langchain applications with Elastic, OpenTelemetry, and Langtrace
OpenTelemetryAPMPythonInstrumentationAzure OpenAILLM Observability

Observing Langchain applications with Elastic, OpenTelemetry, and Langtrace

Langchain applications are growing in use. The ability to build out RAG-based applications, simple AI Assistants, and more is becoming the norm. Observing these applications is even harder. Given the various options that are out there, this blog shows how to use OpenTelemetry instrumentation with Langtrace and ingest it into Elastic Observability APM

Bahubali Shetti

Karthik Kalyanaraman

Yemi Adejumobi

LLM Observability with Elastic, OpenLIT and OpenTelemetry
OpenTelemetryAPMPythonInstrumentationAzure OpenAILLM Observability

LLM Observability with Elastic, OpenLIT and OpenTelemetry

Langchain applications are growing in use. The ability to build out RAG-based applications, simple AI Assistants, and more is becoming the norm. Observing these applications is even harder. Given the various options that are out there, this blog shows how to use OpenTelemetry instrumentation with the OpenLIT instrumentation library to ingest traces into Elastic Observability APM.

Bahubali Shetti

Aman Agarwal

LLM Observability with Elastic: Azure OpenAI Part 2
AzureGenAILLM Observability

LLM Observability with Elastic: Azure OpenAI Part 2

We have added further capabilities to the Azure OpenAI GA package, which now offer prompt and response monitoring, PTU deployment performance tracking, and billing insights!

Muthukumar Paramasivam

Lalit Satapathy

Tracing LangChain apps with Elastic, OpenLLMetry, and OpenTelemetry
OpenTelemetryAPMPythonInstrumentationAzure OpenAILLM Observability

Tracing LangChain apps with Elastic, OpenLLMetry, and OpenTelemetry

LangChain applications are growing in use. The ability to build out RAG-based applications, simple AI Assistants, and more is becoming the norm. Observing these applications is even harder. Given the various options that are out there, this blog shows how to use OpenTelemetry instrumentation with OpenLLMetry and ingest it into Elastic Observability APM

Bahubali Shetti

LLM Observability: Azure OpenAI
Azure OpenAIAzureGenAILLM Observability

LLM Observability: Azure OpenAI

We are excited to announce the general availability of the Azure OpenAI Integration that provides comprehensive Observability into the performance and usage of the Azure OpenAI Service!

Vinay Chandrasekhar

Andres Rodriguez