Skip to main content
Tavily is a search engine built specifically for AI agents (LLMs), delivering real-time, accurate, and factual results at speed. Tavily offers an Extract endpoint that can be used to extract the cleaned, parsed content of one or more URLs.

Overview

Integration details

Tool features

Setup

The integration lives in the @langchain/tavily package, which you can install as shown below:

Credentials

Set up a Tavily API key and set it as an environment variable named TAVILY_API_KEY.
It’s also helpful (but not needed) to set up LangSmith for best-in-class observability:

Instantiation

The tool accepts the following parameters during instantiation:
  • extractDepth (optional, string): Depth of the extraction, either "basic" or "advanced". Default is "basic".
  • includeImages (optional, boolean): Whether to include images in the extraction. Default is false.
  • format (optional, string): Content format. "markdown" or "text". Default is "markdown".
  • includeFavicon (optional, boolean): Include each result’s favicon URL. Default is false.
For a comprehensive overview of the available parameters, refer to the Tavily Extract API documentation.

Invocation

Invoke directly with args

The Tavily extract tool accepts the following arguments during invocation:
  • urls (required): A list of URLs to extract content from.
  • The following arguments can also be set during invocation: extractDepth, includeImages.
NOTE: The optional arguments are available for agents to dynamically set. If you set an argument during instantiation and then invoke the tool with a different value, the tool will use the value you passed during invocation.

Invoke with ToolCall

We can also invoke the tool with a model-generated ToolCall, in which case a ToolMessage will be returned:

Use within an agent

We can use the extract tool directly with a LangChain agent by passing it to createAgent. The agent can dynamically set the list of URLs and toggles like extractDepth and includeImages as part of its tool call.

API reference

For detailed documentation of all Tavily Extract API features and configurations head to the API reference: docs.tavily.com/documentation/api-reference/endpoint/extract