Tool and Function Calling
This page describes how tool and function calling is represented in OpenInference spans: the tools advertised to an
LLM span, the tool calls the model generates, and the results sent back. The execution of a tool is
itself recorded as a TOOL span.
Tool Definitions
Tools available to the LLM are represented using the llm.tools prefix with flattened attributes:
Attribute Pattern
llm.tools.<index>.tool.json_schemallm.tools.<index>.tool.namellm.tools.<index>.tool.description
The json_schema contains the provider-native tool definition as a JSON string. Depending on the provider, it can contain the complete definition or only the parameter schema, and the name and description can appear at different nesting levels.
tool.name is the name of the tool, i.e. the identifier the model uses to call it, and tool.description is the text the model uses to decide whether to call it. Instrumentations SHOULD set tool.name, and SHOULD set tool.description when the definition has one.
Consumers SHOULD prefer the explicit tool.name and tool.description attributes and fall back to extracting them from tool.json_schema for telemetry produced before these attributes were introduced. The tool.json_schema attribute remains unchanged for backwards compatibility and lossless capture of the provider-native definition.
Example Tool Definition
{
"llm.tools.0.tool.name": "get_weather",
"llm.tools.0.tool.description": "Get current weather for a location",
"llm.tools.0.tool.json_schema": "{\"type\": \"function\", \"function\": {\"name\": \"get_weather\", \"description\": \"Get current weather for a location\", \"parameters\": {\"type\": \"object\", \"properties\": {\"location\": {\"type\": \"string\", \"description\": \"City and state\"}}, \"required\": [\"location\"]}}}"
}
Tool Calls in Messages
When an LLM generates tool calls, they are represented in the output messages:
Attribute Pattern for Tool Calls
llm.output_messages.<messageIndex>.message.tool_calls.<toolCallIndex>.tool_call.<attribute>
Where:
<messageIndex>is the zero-based index of the message<toolCallIndex>is the zero-based index of the tool call within the message<attribute>is the specific tool call attribute
Tool Call Attributes
tool_call.id: Unique identifier for the tool calltool_call.function.name: Name of the function being calledtool_call.function.arguments: JSON string containing the function argumentstool_call.reasoning_signature: Opaque provider-issued reasoning echo token attached to this tool call. Use this when a provider attaches reasoning continuity state to the tool-call part itself, such as GeminithoughtSignatureon afunctionCallpart.
Example Tool Call
{
"llm.output_messages.0.message.role": "assistant",
"llm.output_messages.0.message.tool_calls.0.tool_call.id": "call_abc123",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.name": "get_weather",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.arguments": "{\"location\": \"San Francisco, CA\"}",
"llm.output_messages.0.message.tool_calls.0.tool_call.reasoning_signature": "CiQB..."
}
Ordered Tool-Use Content Items
Some providers return tool calls as ordered content parts interleaved with reasoning or text. When preserving that order is necessary for replay, also represent the part in message.contents with message_content.type = "tool_use" and the same tool_call.* suffixes:
{
"llm.output_messages.0.message.role": "assistant",
"llm.output_messages.0.message.contents.0.message_content.type": "reasoning",
"llm.output_messages.0.message.contents.0.message_content.text": "I need the current weather before answering.",
"llm.output_messages.0.message.contents.1.message_content.type": "tool_use",
"llm.output_messages.0.message.contents.1.tool_call.id": "call_abc123",
"llm.output_messages.0.message.contents.1.tool_call.function.name": "get_weather",
"llm.output_messages.0.message.contents.1.tool_call.function.arguments": "{\"location\": \"San Francisco, CA\"}"
}
The message.tool_calls array remains the conventional location for generated tool calls. The ordered message.contents representation is additive and is used when consumers need to reconstruct the provider’s original part sequence.
Multiple Tool Calls
When an LLM makes multiple tool calls in a single response:
{
"llm.output_messages.0.message.role": "assistant",
"llm.output_messages.0.message.tool_calls.0.tool_call.id": "call_001",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.name": "get_weather",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.arguments": "{\"location\": \"New York\"}",
"llm.output_messages.0.message.tool_calls.1.tool_call.id": "call_002",
"llm.output_messages.0.message.tool_calls.1.tool_call.function.name": "get_weather",
"llm.output_messages.0.message.tool_calls.1.tool_call.function.arguments": "{\"location\": \"London\"}"
}
Tool Results
Tool results are typically represented as input messages with role “tool”:
{
"llm.input_messages.3.message.role": "tool",
"llm.input_messages.3.message.content": "{\"temperature\": 72, \"condition\": \"sunny\"}",
"llm.input_messages.3.message.tool_call_id": "call_abc123",
"llm.input_messages.3.message.name": "get_weather"
}
The message.tool_call_id links the result back to the original tool call. The message.name attribute MAY be set to identify which function produced the result — it typically matches tool_call.function.name from the corresponding tool call.
Complete Tool Call Flow Example
- User Request:
{
"llm.input_messages.0.message.role": "user",
"llm.input_messages.0.message.content": "What's the weather in Boston?"
}
- Available Tools:
{
"llm.tools.0.tool.name": "get_weather",
"llm.tools.0.tool.description": "Get current weather",
"llm.tools.0.tool.json_schema": "{\"type\": \"function\", \"function\": {\"name\": \"get_weather\", \"description\": \"Get current weather\", \"parameters\": {\"type\": \"object\", \"properties\": {\"location\": {\"type\": \"string\"}}}}}"
}
- LLM Tool Call:
{
"llm.output_messages.0.message.role": "assistant",
"llm.output_messages.0.message.tool_calls.0.tool_call.id": "call_123",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.name": "get_weather",
"llm.output_messages.0.message.tool_calls.0.tool_call.function.arguments": "{\"location\": \"Boston, MA\"}"
}
- Tool Result (in next request):
{
"llm.input_messages.2.message.role": "tool",
"llm.input_messages.2.message.content": "{\"temperature\": 65, \"condition\": \"cloudy\"}",
"llm.input_messages.2.message.tool_call_id": "call_123"
}
- Final Response:
{
"llm.output_messages.0.message.role": "assistant",
"llm.output_messages.0.message.content": "The current weather in Boston is 65°F and cloudy."
}
Legacy Attributes
Some implementations may use legacy attributes for function calling:
message.function_call_name: Function name (deprecated, use tool_calls)message.function_call_arguments_json: Function arguments (deprecated, use tool_calls)llm.function_call: Complete function call as JSON (deprecated)
New implementations should use the tool_calls structure described above.