Crawl4AI · emploidai Marketplace
emploidai Marketplace
Add-onsAppletsPlugins
Search tools, teams, and capabilitiesPublish
MarketplacePluginsCrawl4AI
Plugin
Limited listing

Crawl4AI

by agimaster · v0.0.3

Access Crawl4AI capabilities to extract content from web pages, etc, return markdown or html format

6.7k installsUpdated Jun 6, 2025
Publisher information is incomplete

This community listing does not yet include every recommended support, privacy, pricing, and permission disclosure. Review the available package permissions before installing.

Capabilities

Tools

Available inside your emploidai workspace after installation.

Data sources

Available inside your emploidai workspace after installation.

Category

tool

Version

0.0.3agimaster

Requirements

Maximum memory 1MB

Pricing

Not disclosed by publisher

Security & access

Review before installing

CompatibleRequires emploidai 1.0.0+

Permissions

  • Uses endpoint capability
  • Uses tool capability
  • Requires encrypted tool credentials

Dependencies

No additional dependencies

Resources

Privacy policy
emploidai Marketplace

Discover capabilities. Review access. Install inside your workspace.

DocumentationSecuritySupportPrivacyTerms

Crawl4AI Plugin for Dify

Overview

Crawl4AI is an open-source web crawler that allows for efficient extraction of content from web pages, This plugin connects Dify to a Docker-deployed Crawl4AI service via HTTP.

Configuration

1. Deploy Crawl4AI Docker Service

First, deploy the Crawl4AI service using Docker on your server. Follow the instructions on the Crawl4AI documentation.

2. Get Crawl4AI Plugin from Plugin Marketplace

The Crawl4AI plugin can be found in the Plugin Marketplace. Install it first.

3. Fill in the configuration in Dify

On the Dify navigation page, click Tools > Crawl4AI > To Authorize and fill in the following information:

  • Server URL: Your Crawl4AI service URL, e.g., http://localhost:11235
  • API Token: The authentication token for your Crawl4AI service. (Not required after Crawl4AI version 0.6.0)

4. Use the tool

You can use the Crawl4AI tool in the following application types:

Chatflow / Workflow applications

Both Chatflow and Workflow applications support adding Crawl4AI tool nodes for web content extraction.

Agent applications

Add the Crawl4AI tool in the Agent application, then use web extraction commands to call this tool.

Features

  • Web Content Extraction

    • Web Content Extraction: Extract content from web pages using Crawl4AI's API
    • Selector Support: Target specific content using CSS selectors
    • Formatted Output: Support for Markdown and HTML output formats
    • Tag Exclusion: Ability to exclude specific HTML tags from extraction
    • Python code reference: https://github.com/unclecode/crawl4ai/blob/main/docs/examples/docker/demo_docker_api.py

  • Web Content Extraction (Legacy)

    • For Crawl4AI versions prior to 0.6.0
    • Python code reference: https://github.com/unclecode/crawl4ai/blob/main/docs/examples/docker_example.py

Development

For development information, please refer to the Dify Plugin Development Documentation.

Source code is available at: https://github.com/AGIMaster/dify-plugin-my-development/tree/master/tools/crawl4ai