AI agent that can scrape webpages
This template is a PoC of a ReAct AI Agent capable of fetching random pages (not only Wikipedia or Google search results). On the top part there's a manual chat node connected to a LangChain ReAct Agent. The agent has access to a workflow tool for getting page content. The page content extraction starts with converting query parameters into a JSON object. There are 3 pre-defined parameters: - url – an address of the page to fetch - method = full / simplified - maxlimit - maximum length for the f
At a glance
AI agent that can scrape webpages is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.
- Platform
- n8n
- Connects
- UNSUPPORTED_SLUG_FORMAT
- Modules
- 16
- Price
- Free
- Version
- v1.0

About this workflow
This template is a PoC of a ReAct AI Agent capable of fetching random pages (not only Wikipedia or Google search results). On the top part there's a manual chat node connected to a LangChain ReAct Agent. The agent has access to a workflow tool for getting page content. The page content extraction starts with converting query parameters into a JSON object. There are 3 pre-defined parameters: - url – an address of the page to fetch - method = full / simplified - maxlimit - maximum length for the final page. For longer pages an error message is returned back to the agent Page content fetching is a multistep process: 1. An HTTP Request mode tries to get the page content. If the page content was successfuly retrieved, a series of post-processing begin: 2. Extract HTML BODY; content 3. Remove all unnecessary tags to recuce the page size 4. Further eliminate external URLs and IMG scr values (based on the method query parameter) 5. Remaining HTML is converted to Markdown, thus recuding the page lengh even more while preserving the basic page structure 6. The remaining content is sent back to an Agent if it's not too long (maxlimit = 70000 by default, see CONFIG node). NB: - You can isolate the HTTP Request part into a separate workflow. - Check the Workflow Tool description, it guides the agent to provide a query string with several parameters instead of a JSON object. Please reach out to Eduard is you need further assistance with you n8n workflows and automations! Note that to use this template, you need to be on n8n version 1.19.4 or later.
How to import this n8n workflow
- 1
Download the workflow JSON file after purchase.
- 2
Open n8n → click the menu → Import from File.
- 3
Select the downloaded JSON and import.
- 4
Set up credentials for each node that requires them.
- 5
Click Execute Workflow to test, then activate.
Setup guide
Setup guide included
Purchase to unlock the full step-by-step guide
Related N8n workflows
Convert HTML to PDF and compress files with CustomJS API
AI agent powered marketing 🛠️ Customer.io tool MCP server 💪 all 9 operations
XOR encryption and decryption with Base64 encoding for workflow data
Extract invoice and PO data from NetSuite - Download CSV and XLSX
🛠️ PagerDuty tool MCP server 💪 all 9 operations
Call center analytics with dual-AI verification using DeepSeek models
Smart email draft generator
Download Threads videos & log results in Google Sheets
Reviews
No reviews yet
Be the first to buy and share your experience.
Leave a review
Sign in to share your experience with this workflow.
Create a free account to purchase workflows.
- JSON blueprint — instant download
- Setup guide PDF included
- 5 downloads · valid 30 days
- Works with n8n
Need help setting this up?
Book a 3-hour live setup session with an Agility consultant.
- Configure live on Google Meet / Zoom
- Free follow-up if workflow has defects
- Platform expert assigned to you