🇺🇸 English • 🇨🇳 中文 • 🇹🇼 繁體中文 • 🇯🇵 日本語 • 🇵🇹 Português • 🇧🇷 Português • 🇰🇷 한국어 • 🇪🇸 Español • 🇩🇪 Deutsch • 🇫🇷 Français • 🇮🇱 עברית • 🇸🇦 العربية • 🇷🇺 Русский • 🇵🇱 Polski • 🇨🇿 Čeština • 🇳🇱 Nederlands • 🇹🇷 Türkçe • 🇺🇦 Українська • 🇻🇳 Tiếng Việt • 🇵🇭 Tagalog • 🇮🇩 Indonesia • 🇹🇭 ไทย • 🇮🇳 हिन्दी • 🇧🇩 বাংলা • 🇵🇰 اردو • 🇷🇴 Română • 🇸🇪 Svenska • 🇮🇹 Italiano • 🇬🇷 Ελληνικά • 🇭🇺 Magyar • 🇫🇮 Suomi • 🇩🇰 Dansk • 🇳🇴 Norsk
OpenInference is a set of conventions and plugins that is complementary to [OpenTelemetry](https://opentelemetry.io/) to
enable tracing of AI applications. OpenInference is natively supported
by [Arize Phoenix](https://github.com/Arize-ai/phoenix) and [Arize AX](https://arize.com/products/ax?utm_source=docs&utm_medium=web&utm_content=openinference), but can be used with any OpenTelemetry-compatible backend as
well.
## Specification
The OpenInference specification is edited in markdown files found in the [spec directory](./spec/). It's designed to
provide insight into the invocation of LLMs and the surrounding application context such as retrieval from vector stores
and the usage of external tools such as search engines or APIs. The specification is transport and file-format agnostic,
and is intended to be used in conjunction with other specifications such as JSON, ProtoBuf, and DataFrames.
## Instrumentation
OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of
languages.
## Python
### Libraries
| Package | Description | Version |
|-------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [`openinference-semantic-conventions`](./python/openinference-semantic-conventions) | Semantic conventions for tracing of LLM Apps. | [](https://pypi.python.org/pypi/openinference-semantic-conventions) |
| [`openinference-instrumentation`](./python/openinference-instrumentation) | Reusable utilities, decorators, configurations, and helpers for instrumentation. | [](https://pypi.python.org/pypi/openinference-instrumentation) |
| [`openinference-instrumentation-agno`](./python/instrumentation/openinference-instrumentation-agno) | OpenInference Instrumentation for Agno Agents. | [](https://pypi.python.org/pypi/openinference-instrumentation-agno) |
| [`openinference-instrumentation-ag2`](./python/instrumentation/openinference-instrumentation-ag2) | OpenInference Instrumentation for AG2. | [](https://pypi.python.org/pypi/openinference-instrumentation-ag2) |
| [`openinference-instrumentation-openai`](./python/instrumentation/openinference-instrumentation-openai) | OpenInference Instrumentation for OpenAI SDK. | [](https://pypi.python.org/pypi/openinference-instrumentation-openai) |
| [`openinference-instrumentation-openai-agents`](./python/instrumentation/openinference-instrumentation-openai-agents) | OpenInference Instrumentation for OpenAI Agents SDK. | [](https://pypi.python.org/pypi/openinference-instrumentation-openai-agents) |
| [`openinference-instrumentation-claude-agent-sdk`](./python/instrumentation/openinference-instrumentation-claude-agent-sdk) | OpenInference Instrumentation for Claude Agent SDK. | [](https://pypi.python.org/pypi/openinference-instrumentation-claude-agent-sdk) |
| [`openinference-instrumentation-llama-index`](./python/instrumentation/openinference-instrumentation-llama-index) | OpenInference Instrumentation for LlamaIndex. | [](https://pypi.python.org/pypi/openinference-instrumentation-llama-index) |
| [`openinference-instrumentation-dspy`](./python/instrumentation/openinference-instrumentation-dspy) | OpenInference Instrumentation for DSPy. | [](https://pypi.python.org/pypi/openinference-instrumentation-dspy) |
| [`openinference-instrumentation-bedrock`](./python/instrumentation/openinference-instrumentation-bedrock) | OpenInference Instrumentation for AWS Bedrock. | [](https://pypi.python.org/pypi/openinference-instrumentation-bedrock) |
| [`openinference-instrumentation-langchain`](./python/instrumentation/openinference-instrumentation-langchain) | OpenInference Instrumentation for LangChain. | [](https://pypi.python.org/pypi/openinference-instrumentation-langchain) |
| [`openinference-instrumentation-mcp`](./python/instrumentation/openinference-instrumentation-mcp) | OpenInference Instrumentation for MCP. | [](https://pypi.python.org/pypi/openinference-instrumentation-mcp) |
| [`openinference-instrumentation-mistralai`](./python/instrumentation/openinference-instrumentation-mistralai) | OpenInference Instrumentation for MistralAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-mistralai) |
| [`openinference-instrumentation-portkey`](./python/instrumentation/openinference-instrumentation-portkey) | OpenInference Instrumentation for Portkey. | [](https://pypi.python.org/pypi/openinference-instrumentation-portkey) |
| [`openinference-instrumentation-guardrails`](./python/instrumentation/openinference-instrumentation-guardrails) | OpenInference Instrumentation for Guardrails. | [](https://pypi.python.org/pypi/openinference-instrumentation-guardrails) |
| [`openinference-instrumentation-vertexai`](./python/instrumentation/openinference-instrumentation-vertexai) | OpenInference Instrumentation for VertexAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-vertexai) |
| [`openinference-instrumentation-crewai`](./python/instrumentation/openinference-instrumentation-crewai) | OpenInference Instrumentation for CrewAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-crewai) |
| [`openinference-instrumentation-haystack`](./python/instrumentation/openinference-instrumentation-haystack) | OpenInference Instrumentation for Haystack. | [](https://pypi.python.org/pypi/openinference-instrumentation-haystack) |
| [`openinference-instrumentation-litellm`](./python/instrumentation/openinference-instrumentation-litellm) | OpenInference Instrumentation for liteLLM. | [](https://pypi.python.org/pypi/openinference-instrumentation-litellm) |
| [`openinference-instrumentation-groq`](./python/instrumentation/openinference-instrumentation-groq) | OpenInference Instrumentation for Groq. | [](https://pypi.python.org/pypi/openinference-instrumentation-groq) |
| [`openinference-instrumentation-instructor`](./python/instrumentation/openinference-instrumentation-instructor) | OpenInference Instrumentation for Instructor. | [](https://pypi.python.org/pypi/openinference-instrumentation-instructor) |
| [`openinference-instrumentation-anthropic`](./python/instrumentation/openinference-instrumentation-anthropic) | OpenInference Instrumentation for Anthropic. | [](https://pypi.python.org/pypi/openinference-instrumentation-anthropic) |
| [`openinference-instrumentation-beeai`](./python/instrumentation/openinference-instrumentation-beeai) | OpenInference Instrumentation for BeeAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-beeai) |
| [`openinference-instrumentation-google-genai`](./python/instrumentation/openinference-instrumentation-google-genai) | OpenInference Instrumentation for Google GenAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-google-genai) |
| [`openinference-instrumentation-google-adk`](./python/instrumentation/openinference-instrumentation-google-adk) | OpenInference Instrumentation for Google ADK. | [](https://pypi.python.org/pypi/openinference-instrumentation-google-adk) |
| [`openinference-instrumentation-autogen-agentchat`](./python/instrumentation/openinference-instrumentation-autogen-agentchat) | OpenInference Instrumentation for Microsoft Autogen AgentChat. | [](https://pypi.python.org/pypi/openinference-instrumentation-autogen-agentchat) |
| [`openinference-instrumentation-pydantic-ai`](./python/instrumentation/openinference-instrumentation-pydantic-ai) | OpenInference Instrumentation for PydanticAI. | [](https://pypi.python.org/pypi/openinference-instrumentation-pydantic-ai) |
| [`openinference-instrumentation-smolagents`](./python/instrumentation/openinference-instrumentation-smolagents) | OpenInference Instrumentation for smolagents. | [](https://pypi.python.org/pypi/openinference-instrumentation-smolagents) |
| [`openinference-instrumentation-pipecat`](./python/instrumentation/openinference-instrumentation-pipecat) | OpenInference Instrumentation for Pipecat. | [](https://pypi.python.org/pypi/openinference-instrumentation-pipecat) |
| [`openinference-instrumentation-agentspec`](./python/instrumentation/openinference-instrumentation-agentspec) | OpenInference Instrumentation for Open Agent Specification. | [](https://pypi.python.org/pypi/openinference-instrumentation-agentspec) |
| [`openinference-instrumentation-strands-agents`](./python/instrumentation/openinference-instrumentation-strands-agents) | OpenInference Instrumentation for Strands Agents. | [](https://pypi.python.org/pypi/openinference-instrumentation-strands-agents) |
| [`openinference-instrumentation-together`](./python/instrumentation/openinference-instrumentation-together) | OpenInference Instrumentation for Together AI. | [](https://pypi.python.org/pypi/openinference-instrumentation-together) |
| [`openinference-instrumentation-typesafe`](./python/instrumentation/openinference-instrumentation-typesafe) | OpenInference Instrumentation for TypeSafe AI. | [](https://pypi.python.org/pypi/openinference-instrumentation-typesafe) |
| [`openinference-instrumentation-ollama`](./python/instrumentation/openinference-instrumentation-ollama) | OpenInference Instrumentation for Ollama. | [](https://pypi.python.org/pypi/openinference-instrumentation-ollama) |
| [`openinference-instrumentation-cohere`](./python/instrumentation/openinference-instrumentation-cohere) | OpenInference Instrumentation for Cohere. | [](https://pypi.python.org/pypi/openinference-instrumentation-cohere) |
## Span Processors
Normalize and convert data across other instrumentation libraries by adding span processors that unify data.
| Package | Description | Version |
| ----------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [`openinference-instrumentation-openlit`](./python/instrumentation/openinference-instrumentation-openlit) | OpenInference Span Processor for OpenLIT traces. | [](https://pypi.python.org/pypi/openinference-instrumentation-openlit) |
| [`openinference-instrumentation-openllmetry`](./python/instrumentation/openinference-instrumentation-openllmetry) | OpenInference Span Processor for OpenLLMetry (Traceloop) traces. | [](https://pypi.python.org/pypi/openinference-instrumentation-openllmetry) |
### Examples
| Name | Description | Complexity Level |
| ----------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------- | ---------------- |
| [Agno](python/instrumentation/openinference-instrumentation-agno/examples/) | Agno agent examples | Beginner |
| [OpenAI SDK](python/instrumentation/openinference-instrumentation-openai/examples/) | OpenAI Python SDK, including chat completions and embeddings | Beginner |
| [Claude Agent SDK](python/instrumentation/openinference-instrumentation-claude-agent-sdk/examples/) | Claude Agent SDK | Beginner |
| [MistralAI SDK](python/instrumentation/openinference-instrumentation-mistralai/examples/) | MistralAI Python SDK | Beginner |
| [VertexAI SDK](python/instrumentation/openinference-instrumentation-vertexai/examples/) | VertexAI Python SDK | Beginner |
| [LlamaIndex](python/instrumentation/openinference-instrumentation-llama-index/examples/) | LlamaIndex query engines | Beginner |
| [DSPy](python/instrumentation/openinference-instrumentation-dspy/examples/) | DSPy primitives and custom RAG modules | Beginner |
| [Boto3 Bedrock Client](python/instrumentation/openinference-instrumentation-bedrock/examples/) | Boto3 Bedrock client | Beginner |
| [LangChain](python/instrumentation/openinference-instrumentation-langchain/examples/) | LangChain primitives and simple chains | Beginner |
| [LiteLLM](python/instrumentation/openinference-instrumentation-litellm/) | A lightweight LiteLLM framework | Beginner |
| [LiteLLM Proxy](python/instrumentation/openinference-instrumentation-litellm/examples/litellm-proxy/) | LiteLLM Proxy to log OpenAI, Azure, Vertex, Bedrock | Beginner |
| [Groq](python/instrumentation/openinference-instrumentation-groq/examples/) | Groq and AsyncGroq chat completions | Beginner |
| [Together AI](python/instrumentation/openinference-instrumentation-together/examples/) | Together and AsyncTogether chat completions, streaming, and tool calls | Beginner |
| [TypeSafe AI](python/instrumentation/openinference-instrumentation-typesafe/examples/) | TypeSafeClient and AsyncTypeSafeClient System One calls (Noul, Choice, Score) | Beginner |
| [Anthropic](python/instrumentation/openinference-instrumentation-anthropic/examples/) | Anthropic Messages client | Beginner |
| [BeeAI](python/instrumentation/openinference-instrumentation-beeai/examples/) | Agentic instrumentation in the BeeAI framework | Beginner |
| [Haystack](python/instrumentation/openinference-instrumentation-haystack/examples/) | A Haystack QA RAG application | Intermediate |
| [OpenAI Agents](python/instrumentation/openinference-instrumentation-openai-agents/examples/) | OpenAI Agents with handoffs | Intermediate |
| [Autogen AgentChat](python/instrumentation/openinference-instrumentation-autogen-agentchat/examples/) | Microsoft Autogen Assistant Agent and Team Chat | Intermediate |
| [AG2](python/instrumentation/openinference-instrumentation-ag2/examples/) | AG2 tool calling, group chats, and sequential chats | Intermediate |
| [PydanticAI](python/instrumentation/openinference-instrumentation-pydantic-ai/examples/) | PydanticAI agent examples | Intermediate |
| [Pipecat](python/instrumentation/openinference-instrumentation-pipecat/examples/) | Pipecat application examples | Intermediate |
| [Ollama](python/instrumentation/openinference-instrumentation-ollama/examples/) | Ollama chat, streaming, and tool calls | Beginner |
| [Cohere](python/instrumentation/openinference-instrumentation-cohere/examples/) | Cohere ClientV2 chat completions | Beginner |
## JavaScript
### Libraries
| Package | Description | Version |
| ----------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [`@arizeai/openinference-semantic-conventions`](./js/packages/openinference-semantic-conventions) | Semantic conventions for tracing of LLM Apps. | [](https://www.npmjs.com/package/@arizeai/openinference-semantic-conventions) |
| [`@arizeai/openinference-core`](./js/packages/openinference-core) | Reusable utilities, configuration, and helpers for instrumentation. | [](https://www.npmjs.com/package/@arizeai/openinference-core) |
| [`@arizeai/openinference-instrumentation-bedrock`](./js/packages/openinference-instrumentation-bedrock) | OpenInference Instrumentation for AWS Bedrock. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-bedrock) |
| [`@arizeai/openinference-instrumentation-bedrock-agent-runtime`](./js/packages/openinference-instrumentation-bedrock-agent-runtime) | OpenInference Instrumentation for AWS Bedrock Agent Runtime. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-bedrock-agent-runtime) |
| [`@arizeai/openinference-instrumentation-beeai`](./js/packages/openinference-instrumentation-beeai) | OpenInference Instrumentation for BeeAI. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-beeai) |
| [`@arizeai/openinference-instrumentation-langchain`](./js/packages/openinference-instrumentation-langchain) | OpenInference Instrumentation for LangChain.js. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-langchain) |
| [`@arizeai/openinference-instrumentation-mcp`](./js/packages/openinference-instrumentation-mcp) | OpenInference Instrumentation for MCP. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-mcp) |
| [`@arizeai/openinference-instrumentation-openai`](./js/packages/openinference-instrumentation-openai) | OpenInference Instrumentation for OpenAI SDK. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-openai) |
| [`@arizeai/openinference-instrumentation-anthropic`](./js/packages/openinference-instrumentation-anthropic) | OpenInference Instrumentation for the Anthropic SDK. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-anthropic) |
| [`@arizeai/openinference-instrumentation-claude-agent-sdk`](./js/packages/openinference-instrumentation-claude-agent-sdk) | OpenInference Instrumentation for Claude Agent SDK. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-claude-agent-sdk) |
| [`@arizeai/openinference-vercel`](./js/packages/openinference-vercel) | OpenInference Support for Vercel AI SDK. | [](https://www.npmjs.com/package/@arizeai/openinference-vercel) |
| [`@arizeai/openinference-tanstack-ai`](./js/packages/openinference-tanstack-ai) | OpenInference middleware for TanStack AI. | [](https://www.npmjs.com/package/@arizeai/openinference-tanstack-ai) |
| [`@arizeai/openinference-genai`](./js/packages/openinference-genai) | OpenInference Support for GenAI conventions | [](https://www.npmjs.com/package/@arizeai/openinference-genai) |
| [`@arizeai/openinference-instrumentation-typesafe`](./js/packages/openinference-instrumentation-typesafe) | OpenInference Instrumentation for the TypeSafe AI SDK. | [](https://www.npmjs.com/package/@arizeai/openinference-instrumentation-typesafe) |
### Examples
| Name | Description | Complexity Level |
| --- | --- | --- |
| [TypeSafe AI](js/packages/openinference-instrumentation-typesafe/examples/) | Classification, structured questions, and confidence-gated routing to an LLM | Beginner |
## Java
### Libraries
| Package | Description | Version |
| --------------------------------------------------------------------------------------------------------------- | ---------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [`openinference-semantic-conventions`](./java/openinference-semantic-conventions) | Semantic conventions for tracing of LLM Apps. | [](https://central.sonatype.com/artifact/com.arize/openinference-semantic-conventions) |
| [`openinference-instrumentation`](./java/openinference-instrumentation) | Base instrumentation utilities. | [](https://central.sonatype.com/artifact/com.arize/openinference-instrumentation) |
| [`openinference-instrumentation-langchain4j`](./java/instrumentation/openinference-instrumentation-langchain4j) | OpenInference Instrumentation for LangChain4j. | [](https://central.sonatype.com/artifact/com.arize/openinference-instrumentation-langchain4j) |
| [`openinference-instrumentation-springAI`](./java/instrumentation/openinference-instrumentation-springAI) | OpenInference Instrumentation for Spring AI. | [](https://central.sonatype.com/artifact/com.arize/openinference-instrumentation-springAI) |
| [`openinference-instrumentation-annotation`](./java/instrumentation/openinference-instrumentation-annotation) | Annotation-based manual tracing with ByteBuddy. | [](https://central.sonatype.com/artifact/com.arize/openinference-instrumentation-annotation) |
| [`openinference-instrumentation-adk-java`](./java/instrumentation/openinference-instrumentation-adk-java) | OpenInference Instrumentation for Google ADK Java (`-javaagent`). | [](https://central.sonatype.com/artifact/com.arize/openinference-instrumentation-adk-java) |
### Examples
| Name | Description | Complexity Level |
| -------------------------------------------------------- | ---------------------------------------------- | ---------------- |
| [LangChain4j Example](java/examples/langchain4j-example) | Simple example using LangChain4j with OpenAI | Beginner |
| [Spring AI Example](java/examples/spring-ai-example) | Spring AI example with OpenAI and tool calling | Beginner |
| [Annotation Example](java/examples/annotation-example) | Annotation-based tracing with `@Chain`, `@LLM`, `@Tool`, `@Agent` | Beginner |
| [Programmatic Example](java/examples/programmatic-example) | Manual tracing with typed span classes (`LLMSpan`, `AgentSpan`, etc.) | Beginner |
| [ADK Java Example](java/examples/adk-java-example) | Google ADK for Java agent with a function tool, traced by the ADK `-javaagent` | Beginner |
## Go
### Libraries
| Package | Description | Version |
| --- | --- | --- |
| [`openinference-semantic-conventions`](./go/openinference-semantic-conventions) | Semantic conventions for tracing of LLM Apps. | `go get github.com/Arize-ai/openinference/go/openinference-semantic-conventions` |
| [`openinference-instrumentation`](./go/openinference-instrumentation) | Suppression, context attribute propagation, and `TraceConfig` masking. Honors `OPENINFERENCE_HIDE_*` env vars. | `go get github.com/Arize-ai/openinference/go/openinference-instrumentation` |
| [`openinference-instrumentation-anthropic-sdk-go`](./go/openinference-instrumentation-anthropic-sdk-go) | OpenInference Instrumentation for the Anthropic Go SDK (`anthropics/anthropic-sdk-go`). | `go get github.com/Arize-ai/openinference/go/openinference-instrumentation-anthropic-sdk-go` |
| [`openinference-instrumentation-openai-go`](./go/openinference-instrumentation-openai-go) | OpenInference Instrumentation for the official OpenAI Go SDK ([`openai/openai-go`](https://github.com/openai/openai-go)). | `go get github.com/Arize-ai/openinference/go/openinference-instrumentation-openai-go` |
Requires Go 1.25+. Pair with [`arize-otel-go`](https://github.com/Arize-ai/arize-otel-go) for the one-line OTLP/HTTP setup to [Arize AX](https://arize.com/products/ax?utm_source=docs&utm_medium=web&utm_content=openinference), or wire up any OTel exporter (e.g. [Phoenix](https://github.com/Arize-ai/phoenix) at `http://localhost:6006/v1/traces`).
## Supported Destinations
OpenInference supports the following destinations as span collectors.
- ✅ [Arize Phoenix](https://github.com/Arize-ai/phoenix)
- ✅ [Arize AX](https://arize.com/products/ax?utm_source=docs&utm_medium=web&utm_content=openinference)
- ✅ Any OTEL-compatible collector
## Community
Join our community to connect with thousands of machine learning practitioners and LLM observability enthusiasts!
- 🌍 Join our [Slack community](https://join.slack.com/t/arize-ai/shared_invite/zt-3lqwr2oc3-7rhdyYEh82zJL_UhPKrb0A).
- 💡 Ask questions and provide feedback in the _#phoenix-support_ channel.
- 🌟 Leave a star on our [GitHub](https://github.com/Arize-ai/openinference).
- 🐞 Report bugs with [GitHub Issues](https://github.com/Arize-ai/openinference/issues).
- 𝕏 Follow us on [X](https://twitter.com/ArizePhoenix).
- 🗺️ Check out our [roadmap](https://github.com/orgs/Arize-ai/projects/45) to see where we're heading next.