Skip to main content
The langsmith-codex-plugins marketplace ships a tracing plugin that sends OpenAI Codex session data to LangSmith. Use it to inspect agent turns, model metadata, token usage, tool calls, and subagent threads from your Codex workflows.

Prerequisites

Before setting up tracing, ensure you have:

Install and enable the plugin

Add the marketplace using the Codex CLI:
Enable plugin hooks and the tracing plugin globally in ~/.codex/config.toml, or only for a specific project in .codex/config.toml:

Configure tracing

Tracing is disabled until either TRACE_TO_LANGSMITH is "true" or enabled is true in a config file. Configure credentials with environment variables, a JSON config file, or both.

Environment variables

The plugin reads Codex-specific variables first, then falls back to the generic LangSmith SDK variables. Add the variables to your shell configuration file (~/.zshrc, ~/.bashrc, or ~/.bash_profile):

Config file

Use <project>/.codex/langsmith.json for project-level settings or ~/.codex/langsmith.json for global defaults. The global file loads first, the project file overrides it, and matching environment variables take precedence over both.
Keep config files that include API keys out of version control.

Trace to multiple destinations

Set replicas in langsmith.json or LANGSMITH_CODEX_RUNS_ENDPOINTS to send the same trace data to additional LangSmith workspaces or projects. When set, the replica list overrides the other client settings. Tracing to multiple replicas is useful for:
  • Sending traces to both a production and staging project.
  • Tracing to multiple workspaces with different API keys.
  • Adding extra metadata to specific replica destinations.
Each replica object supports the following fields:

What gets traced

Each LLM run includes:
  • Inputs: accumulated conversation messages.
  • Outputs: assistant response content.
  • Metadata: model provider, model name, stop reason, and token usage.
Tool calls (function calls, shell calls, computer calls, file reads, web searches) are included with their inputs and outputs. Subagent threads are resolved and uploaded as nested child runs under the parent turn. Interrupted turns where the user cancels mid-response are still uploaded once the session completes.

View traces in LangSmith

Open the configured LangSmith project and complete a Codex turn. By default traces appear in the codex project. The plugin uploads completed Codex transcript data, including messages, tool call inputs and outputs, model metadata, token usage, and subagent thread structure.
The plugin uploads full Codex transcript data to LangSmith. Do not enable tracing for sessions that contain data you do not want stored in LangSmith.

Troubleshooting

If traces do not appear in LangSmith:
  • Confirm plugin_hooks = true and the tracing plugin is enabled in config.toml.
  • Confirm TRACE_TO_LANGSMITH=true is visible to the Codex process.
  • Confirm LANGSMITH_CODEX_API_KEY or LANGSMITH_API_KEY is set and valid.
  • If runs land in the wrong project, set LANGSMITH_CODEX_PROJECT or the project config key.
  • If a custom endpoint is not used, set LANGSMITH_CODEX_ENDPOINT or the api_url config key.