Python auto-instrumentation library for GenAI SDK. Traces are fully OpenTelemetry compatible and can be sent to any OpenTelemetry collector for viewing, such as Arize Phoenix.
pip install -Uqqq openinference-instrumentation-google-genai
Install openinference-instrumentation-google-genai and arize-phoenix.
pip install -U \
openinference-instrumentation-google-genai \
arize-phoenix \
opentelemetry-sdk \
opentelemetry-exporter-otlp \
"opentelemetry-proto>=1.12.0"
Start the phoenix server so that it is ready to receive traces.
The phoenix server runs entirely on your machine and does not send data over the internet.
phoenix serve
Instrumenting genai is simple.
from openinference.instrumentation.google-genai import GoogleGenAIInstrumentor
from opentelemetry.exporter.otlp.proto.grpc.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
endpoint = "http://127.0.0.1:4317"
tracer_provider = TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
GoogleGenAIInstrumentor().instrument(tracer_provider=tracer_provider)
Now, all calls by generate_content are instrumented and can be viewed in the phoenix UI.
This instrumentation is a work in progress