AutomationMart
Home/Browse/AI agent that can scrape webpages
n8n

AI agent that can scrape webpages

n8nn8n16 modulesv1.0
UNSUPPORTED_SLUG_FORMAT

This template is a PoC of a ReAct AI Agent capable of fetching random pages (not only Wikipedia or Google search results). On the top part there's a manual chat node connected to a LangChain ReAct Agent. The agent has access to a workflow tool for getting page content. The page content extraction starts with converting query parameters into a JSON object. There are 3 pre-defined parameters: - url – an address of the page to fetch - method = full / simplified - maxlimit - maximum length for the f

At a glance

AI agent that can scrape webpages is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.

Platform
n8n
Connects
UNSUPPORTED_SLUG_FORMAT
Modules
16
Price
Free
Version
v1.0
AI agent that can scrape webpages workflow diagram

About this workflow

This template is a PoC of a ReAct AI Agent capable of fetching random pages (not only Wikipedia or Google search results). On the top part there's a manual chat node connected to a LangChain ReAct Agent. The agent has access to a workflow tool for getting page content. The page content extraction starts with converting query parameters into a JSON object. There are 3 pre-defined parameters: - url – an address of the page to fetch - method = full / simplified - maxlimit - maximum length for the final page. For longer pages an error message is returned back to the agent Page content fetching is a multistep process: 1. An HTTP Request mode tries to get the page content. If the page content was successfuly retrieved, a series of post-processing begin: 2. Extract HTML BODY; content 3. Remove all unnecessary tags to recuce the page size 4. Further eliminate external URLs and IMG scr values (based on the method query parameter) 5. Remaining HTML is converted to Markdown, thus recuding the page lengh even more while preserving the basic page structure 6. The remaining content is sent back to an Agent if it's not too long (maxlimit = 70000 by default, see CONFIG node). NB: - You can isolate the HTTP Request part into a separate workflow. - Check the Workflow Tool description, it guides the agent to provide a query string with several parameters instead of a JSON object. Please reach out to Eduard is you need further assistance with you n8n workflows and automations! Note that to use this template, you need to be on n8n version 1.19.4 or later.

n8n

How to import this n8n workflow

  1. 1

    Download the workflow JSON file after purchase.

  2. 2

    Open n8n → click the menu → Import from File.

  3. 3

    Select the downloaded JSON and import.

  4. 4

    Set up credentials for each node that requires them.

  5. 5

    Click Execute Workflow to test, then activate.

Setup guide

Setup guide included

Purchase to unlock the full step-by-step guide

Related N8n workflows

Convert HTML to PDF and compress files with CustomJS API

This n8n template demonstrates how to convert HTML into a PDF, compress the generated PDF, and return it as a binary response using the PDF Toolkit from www.customjs.space. Notice Community nodes can only be installed on self-hosted instances of n8n. @custom-js/n8n-nodes-pdf-toolkit What this workflow does - Convert the requested HTML to PDF. - Compress the PDF file. - Use a Code node to handle URLs pointing to PDF files if they exceed 6MB. - Compress the PDF pages. Requirements - Self-hosted n8

Free

AI agent powered marketing 🛠️ Customer.io tool MCP server 💪 all 9 operations

Need help? Want access to this workflow + many more paid workflows + live Q&A sessions with a top verified n8n creator? Join the community Complete MCP server exposing all Customer.io Tool operations to AI agents. Zero configuration needed - all 9 operations pre-built. ⚡ Quick Setup 1. Import this workflow into your n8n instance 2. Activate the workflow to start your MCP server 3. Copy the webhook URL from the MCP trigger node 4. Connect AI agents using the MCP URL 🔧 How it Works • MCP Trigger:

Free

XOR encryption and decryption with Base64 encoding for workflow data

This workflow performs basic XOR-based encryption and decryption using a custom password. It is intended to be triggered by another workflow and processes structured input in JSON format. Input Structure The workflow expects a single array of objects with the following fields: - action-type: either "encrypt" or "decrypt" - key: the password used for encryption and decryption - data: the content to encrypt or decrypt Example: Encryption Input Example: Decryption Input Output The output returns an

Free

Extract invoice and PO data from NetSuite - Download CSV and XLSX

Extract Invoice and PO Data from NetSuite with Koncile OCR Automatically download invoice or purchase order documents (CSV, XLSX, or PDF) from NetSuite and send them to Koncile for data extraction. Connect to NetSuite to retrieve new invoice or PO files. Send documents to Koncile OCR to extract structured data like invoice number, PO number, dates, amounts, and vendor details. Get clean, structured results — perfect for financial tracking, reconciliation, or integration with your tools (Exce

Free

🛠️ PagerDuty tool MCP server 💪 all 9 operations

Complete MCP server exposing all PagerDuty Tool operations to AI agents. Zero configuration needed - all 9 operations pre-built. ⚡ Quick Setup Need help? Want access to more workflows and even live Q&A sessions with a top verified n8n creator.. All 100% free? Join the community 1. Import this workflow into your n8n instance 2. Activate the workflow to start your MCP server 3. Copy the webhook URL from the MCP trigger node 4. Connect AI agents using the MCP URL 🔧 How it Works • MCP Trigger: Serve

Free

Call center analytics with dual-AI verification using DeepSeek models

The workflow is well-designed for CRM analysis with a robust quality control mechanism. The dual-AI approach ensures reliable results, while the webhook integration makes it production-ready for real-time CRM data processing. - Dual-AI Architecture: Uses DeepSeek Reasoner for analysis and DeepSeek Chat for verification. - Flexible Input: Supports both manual testing and production webhook integration. - Quality Assurance: Built-in verification system to ensure report accuracy. - Comprehensive An

Free

Smart email draft generator

AI-Powered Email Draft Automation Workflow In this guide, we’ll walk you through setting up an AI-driven workflow that automatically processes incoming emails using a custom AI model (e.g., Llama), prepares email content, and saves it as a Gmail draft. Ready to automate your email drafting process? Let’s dive in! What’s the Goal? - Automatically detect and process new emails via IMAP. - Use a custom AI model to analyze and generate email content. - Prepare structured and relevant email

Free

Download Threads videos & log results in Google Sheets

Threads Video Downloader & Google Drive Logger Automate downloading Threads videos from URLs, upload them to Google Drive, and log results in Google Sheets using n8n. API Source: Threads Downloader on RapidAPI --- Workflow Explanation | Node | Explanation | | ---------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------- | | On form submission | Trigger workflow when a user submits a Thr

Free

Reviews

No reviews yet

Be the first to buy and share your experience.

Leave a review

Sign in to share your experience with this workflow.

Log in to review
Free
No ratings yet

Create a free account to purchase workflows.

  • JSON blueprint — instant download
  • Setup guide PDF included
  • 5 downloads · valid 30 days
  • Works with n8n

Need help setting this up?

Book a 3-hour live setup session with an Agility consultant.

₹2,499/ session
3 hrs · video call
  • Configure live on Google Meet / Zoom
  • Free follow-up if workflow has defects
  • Platform expert assigned to you
Book installation session
Free