Extract Clean Web Content with Anti-Bot Fallback for AI Agents & Workflows

This workflow contains community nodes that are only compatible with the self-hosted version of n8n. Clean Web Content Extraction with Anti-Bot Fallback Extract clean and structured text from any webpage with optional fallback to an anti-bot scraping service. Ideal for AI tools and content workflows. 🧠 How it Works This sub-workflow enables reliable and clean scraping of any public webpage by simply passing a url parameter. It is designed to be embedded into other workflows or used as a tool for AI agents. It supports two output modes: - fulltext: true — returns { title, text } with full page content - fulltext: false — returns { title, url, content } with a short excerpt 💡 If the site is protected by anti-bot systems (like Cloudflare), it will automatically fallback to Scrape.do, a scraping API with a generous free plan. 🧩 This template requires the n8n-nodes-webpage-content-extractor community node, so it only works in self-hosted n8n environments. 🚀 Use Cases - As a reusable sub-workflow, via Execute Sub-workflow node. - As a tool for an AI Agent, compatible with Call n8n Workflow Tool. Perfect for chatbots, summarization workflows, or RSS/feed enrichment. Empowers your AI Agent with the ability to browse and extract readable content from websites automatically. 🔖 Parameters - url (string): the webpage URL to scrape - fulltext (boolean): set true for full page content, false for summarized output ⚙️ Setup - Install the community node n8n-nodes-webpage-content-extractor in your self-hosted n8n instance. - Create a free account at Scrape.do and obtain your API Token. - In the workflow, locate the Scrape.do HTTP Request node and configure the credentials using your API Token. - Detailed step-by-step instructions are available in the workflow notes. The Scrape.do API is only used as a fallback when conventional scraping fails, helping you preserve your API credits.