Evaluation metric example: RAG document relevance
n8n19 modulesv1.0AI evaluation in n8n This is a template for n8n's evaluation feature. Evaluation is a technique for getting confidence that your AI workflow performs reliably, by running a test dataset containing different inputs through the workflow. By calculating a metric (score) for each input, you can see where the workflow is performing well and where it isn't. How it works This template shows how to calculate a workflow evaluation metric: retrieved document relevance (i.e. whether the information retrie
At a glance
Evaluation metric example: RAG document relevance is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.
- Platform
- n8n
- Connects
- UNSUPPORTED_SLUG_FORMAT
- Modules
- 19
- Price
- Free
- Version
- v1.0
About this workflow
AI evaluation in n8n This is a template for n8n's evaluation feature. Evaluation is a technique for getting confidence that your AI workflow performs reliably, by running a test dataset containing different inputs through the workflow. By calculating a metric (score) for each input, you can see where the workflow is performing well and where it isn't. How it works This template shows how to calculate a workflow evaluation metric: retrieved document relevance (i.e. whether the information retrieved from a vector store is relevant to the question). The workflow takes a question and checks whether the information retrieved to answer it is relevant. To run this workflow, you need to insert documents into a vector data store, so that they can be retrieved by the agent to answer questions. You can do this by running the top part of the workflow once. The main workflow works as follows: - We use an evaluation trigger to read in our dataset - It is wired up in parallel with the regular trigger so that the workflow can be started from either one. More info - We make sure that the agent outputs the list data from the tools that it used - If we’re evaluating (i.e. the execution started from the evaluation trigger), we calculate the relevance metric using AI to compare the retrieved documents with the question - We pass this information back to n8n as a metric - If we’re not evaluating we avoid calculating the metric, to reduce cost
How to import this n8n workflow
- 1
Download the workflow JSON file after purchase.
- 2
Open n8n → click the menu → Import from File.
- 3
Select the downloaded JSON and import.
- 4
Set up credentials for each node that requires them.
- 5
Click Execute Workflow to test, then activate.
Setup guide
Setup guide included
Purchase to unlock the full step-by-step guide
Related N8n workflows
ADF: adf_Second_Pipeline
Find relevant X tweets based on your profile and suggest responses
Automated AWS S3 / Azure / Google to local MinIO object backup with scheduling
Learn JavaScript coding with an interactive RPG-style tutorial game
🛠️ PagerDuty tool MCP server 💪 all 9 operations
Learn JavaScript data processing with code node: filtering, analysis & export examples
🛠️ AWS Transcribe Tool MCP server 💪 all operations
Create customized Google Slides presentations from CSV data for cold outreach 🚀
Reviews
No reviews yet
Be the first to buy and share your experience.
Leave a review
Sign in to share your experience with this workflow.
Create a free account to purchase workflows.
- JSON blueprint — instant download
- Setup guide PDF included
- 5 downloads · valid 30 days
- Works with n8n
Need help setting this up?
Book a 3-hour live setup session with an Agility consultant.
- Configure live on Google Meet / Zoom
- Free follow-up if workflow has defects
- Platform expert assigned to you