← Back to Recursive Web Crawler
Privacy Policy
Data Collection
This plugin does not collect or store any personal data.
Network Access
This plugin sends HTTP/HTTPS requests to the URLs explicitly provided by the user, and fetches the content of those web pages in order to perform crawling. This network access to user-specified targets is the core function of the plugin. The plugin does not send the fetched content to any third-party service; all processing happens within the Dify runtime.
Data Processing
Fetched web page content is parsed into structured JSON (title, Markdown content, links, metadata) and returned to the workflow. No data is retained after the request completes.
User Responsibility
The user is responsible for ensuring they have the right to crawl the target websites and for complying with the target sites' terms of service and robots.txt.
Contact
For privacy-related questions, please contact: fangyong20062006@gmail.com