Apify actor integration

Integrate with the Apify actor tool using LangChain Python.

Apify Actors are cloud programs designed for a wide range of web scraping, crawling, and data extraction tasks. These actors facilitate automated data gathering from the web, enabling users to extract, process, and store information efficiently. Actors can be used to perform tasks like scraping e-commerce sites for product details, monitoring price changes, or gathering search engine results. They integrate seamlessly with Apify Datasets, allowing the structured data collected by actors to be stored, managed, and exported in formats like JSON, CSV, or Excel for further analysis or use.

Overview

This notebook walks you through using Apify Actors with LangChain to automate web scraping and data extraction. The langchain-apify package integrates Apify’s cloud-based tools with LangChain agents, enabling efficient data collection and processing for AI applications.

Integration details

Class	Package	Serializable	JS support	Version
ApifyActorsTool	langchain-apify	✅	✅

Tool features

Returns artifact	Native async	Return data	Pricing
❌	✅	Actor output (varies by Actor)	Pay-per-use, free tier available

Setup

This integration lives in the langchain-apify package. The package can be installed using pip.

pip install langchain-apify

Prerequisites

• Apify account: Register your free Apify account.
• Apify API token: Learn how to get your API token in the Apify documentation.

import os

os.environ["APIFY_TOKEN"] = "your-apify-token"
os.environ["OPENAI_API_KEY"] = "your-openai-api-key"

Pricing

Apify uses pay-per-use pricing with a free tier available. Pricing varies by Actor—some Actors are free (you only pay for platform usage), while others charge per result or event.

Instantiation

Here we instantiate the ApifyActorsTool to be able to call RAG Web Browser Apify Actor. This Actor provides web browsing functionality for AI and LLM applications, similar to the web browsing feature in ChatGPT. Any Actor from the Apify Store can be used in this way.

from langchain_apify import ApifyActorsTool

tool = ApifyActorsTool("apify/rag-web-browser")

Invocation

The ApifyActorsTool takes a single argument, which is run_input - a dictionary that is passed as a run input to the Actor. Run input schema documentation can be found in the input section of the Actor details page. See RAG Web Browser input schema.

tool.invoke({"run_input": {"query": "what is apify?", "maxResults": 2}})

Chaining

We can provide the created tool to an agent. When asked to search for information, the agent will call the Apify Actor, which will search the web, and then retrieve the search results.

pip install langgraph langchain-openai

from langchain.messages import ToolMessage
from langchain_openai import ChatOpenAI
from langchain.agents import create_agent


model = ChatOpenAI(model="gpt-5-mini")
tools = [tool]
graph = create_agent(model, tools=tools)

inputs = {"messages": [("user", "search for what is Apify")]}
stream = graph.stream_events(inputs, version="v3")
for snapshot in stream.values:
    message = snapshot["messages"][-1]
    # skip tool messages
    if isinstance(message, ToolMessage):
        continue
    message.pretty_print()

================================ Human Message =================================

search for what is Apify
================================== Ai Message ==================================
Tool Calls:
  apify_actor_apify_rag-web-browser (call_27mjHLzDzwa5ZaHWCMH510lm)
 Call ID: call_27mjHLzDzwa5ZaHWCMH510lm
  Args:
    run_input: {"run_input":{"query":"Apify","maxResults":3,"outputFormats":["markdown"]}}
================================== Ai Message ==================================

Apify is a comprehensive platform for web scraping, browser automation, and data extraction. It offers a wide array of tools and services that cater to developers and businesses looking to extract data from websites efficiently and effectively. Here's an overview of Apify:

1. **Ecosystem and Tools**:
   - Apify provides an ecosystem where developers can build, deploy, and publish data extraction and web automation tools called Actors.
   - The platform supports various use cases such as extracting data from social media platforms, conducting automated browser-based tasks, and more.

2. **Offerings**:
   - Apify offers over 10,000 ready-made scraping tools and code templates.
   - Users can also build custom solutions or hire Apify's professional services for more tailored data extraction needs.

3. **Technology and Integration**:
   - The platform supports integration with popular tools and services like Zapier, GitHub, Google Sheets, Pinecone, and more.
   - Apify supports open-source tools and technologies such as JavaScript, Python, Puppeteer, Playwright, Selenium, and its own Crawlee library for web crawling and browser automation.

4. **Community and Learning**:
   - Apify hosts a community on Discord where developers can get help and share expertise.
   - It offers educational resources through the Web Scraping Academy to help users become proficient in data scraping and automation.

5. **Enterprise Solutions**:
   - Apify provides enterprise-grade web data extraction solutions with high reliability, 99.95% uptime, and compliance with SOC2, GDPR, and CCPA standards.

For more information, you can visit [Apify's official website](https://apify.com/) or their [GitHub page](https://github.com/apify) which contains their code repositories and further details about their projects.

Additional Actor examples

The Apify Store contains thousands of prebuilt Actors. Here are examples of other popular Actors:

Instagram Scraper

from langchain_apify import ApifyActorsTool

instagram_tool = ApifyActorsTool("apify/instagram-scraper")

# Scrape Instagram posts
result = instagram_tool.invoke({
    "run_input": {
        "directUrls": ["https://www.instagram.com/humansofny/"],
        "resultsLimit": 10
    }
})

Google Search Results Scraper

google_search_tool = ApifyActorsTool("apify/google-search-scraper")

# Scrape Google Search results
result = google_search_tool.invoke({
    "run_input": {
        "queries": "langchain python tutorial",
        "maxPagesPerQuery": 1
    }
})

Browse the Apify Store to discover more Actors for your use case.

When to use Apify

Apify is ideal when you need:

• Access to thousands of prebuilt Actors for various platforms (social media, e-commerce, search engines, etc.)
• Custom web scraping and automation workflows beyond simple search
• Infrastructure-free scraping (a serverless platform handles scaling and maintenance)
• Flexible Actor ecosystem – run any Actor from the Apify Store

---

API reference

For more information on how to use this integration, see the git repository or the Apify integration documentation.

---

Using Apify MCP Server

Unsure which Actor to use or what parameters it requires? The Apify MCP (Model Context Protocol) server can help you discover available Actors, explore their input schemas, and understand parameter requirements through the Model Context Protocol.

To use the Apify MCP server with LangChain:

import os
from langchain_mcp_adapters.client import MultiServerMCPClient
from langchain.agents import create_agent

client = MultiServerMCPClient({
    "apify": {
        "transport": "http",
        "url": "https://mcp.apify.com",
        "headers": {
            "Authorization": f"Bearer {os.environ['APIFY_TOKEN']}",
        },
    }
})

tools = await client.get_tools()
agent = create_agent("gpt-5-mini", tools)

For more information, see the LangChain MCP documentation and Apify MCP server.

---

Connect these docs to Claude, VSCode, and more via MCP for real-time answers.

Edit this page on GitHub or file an issue.