This workflow with AI agent is designed to navigate through the page to retrieve specific type of information (in this example: social media profile links). The agent is equipped with 2 tools: - text tool: to retrieve all the text from the page, - URLs tool: to extract all possible links from the page. π‘ You can edit prompt and JSON schema connected to the agent in order to return other data then social media profile links. π This workflow uses Supabase as storage (input/output). Feel free to

This workflow with AI agent is designed to navigate through the page to retrieve specific type of information (in this example: social media profile links). The agent is equipped with 2 tools: - text tool: to retrieve all the text from the page, - URLs tool: to extract all possible links from the page. π‘ You can edit prompt and JSON schema connected to the agent in order to return other data then social media profile links. π This workflow uses Supabase as storage (input/output). Feel free to change it to any other database of your choice. π¬ See this workflow in action in my YouTube video. How it works? The workflow uses the input URL (website) as a starting point to retrieve the data (e.g. example.com). Using the "URLs tool", the agent is able to retrieve all links from the page and navigate to them. For example, if you want to retrieve contact information, agent will try to find a subpage that might contain this information (e.g. example.com/contact) and extract the information using the text tool. Set up steps 1. Connect database with input data (website addresses) or pin sample data to trigger node. 2. Configure the crawling agent to retrieve the desired data (e.g. modify prompt and/or parsing schema). 3. Set credentials for OpenAI. 4. Optionally: split agent tools to separate workflows. If you like this workflow, please subscribe to my YouTube channel and/or my newsletter.
Download the workflow JSON file after purchase.
Open n8n β click the menu β Import from File.
Select the downloaded JSON and import.
Set up credentials for each node that requires them.
Click Execute Workflow to test, then activate.
Setup guide included
Purchase to unlock the full step-by-step guide
No reviews yet
Be the first to buy and share your experience.
Leave a review
Sign in to share your experience with this workflow.
Create a free account to purchase workflows.
Need help setting this up?
Book a 3-hour live setup session with an Agility consultant.