AutomationMart
Home/Browse/Evaluation metric: summarization
n8n

Evaluation metric: summarization

n8nn8n14 modulesv1.0
UNSUPPORTED_SLUG_FORMAT

This n8n template demonstrates how to calculate the evaluation metric "Summarization" which in this scenario, measures the LLM's accuracy and faithfulness in producing summaries which are based on an incoming Youtube transcript. The scoring approach is adapted from How it works This evaluation works best for an AI summarization workflows. For our scoring, we simple compare the generated response to the original transcript. A key factor is to look out information in the response which is not

At a glance

Evaluation metric: summarization is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.

Platform
n8n
Connects
UNSUPPORTED_SLUG_FORMAT
Modules
14
Price
Free
Version
v1.0
Evaluation metric: summarization workflow diagram

About this workflow

This n8n template demonstrates how to calculate the evaluation metric "Summarization" which in this scenario, measures the LLM's accuracy and faithfulness in producing summaries which are based on an incoming Youtube transcript. The scoring approach is adapted from How it works This evaluation works best for an AI summarization workflows. For our scoring, we simple compare the generated response to the original transcript. A key factor is to look out information in the response which is not mentioned in the documents. A high score indicates LLM adherence and alignment whereas a low score could signal inadequate prompt or model hallucination. Requirements n8n version 1.94+ Check out this Google Sheet for a sample data

n8n

How to import this n8n workflow

  1. 1

    Download the workflow JSON file after purchase.

  2. 2

    Open n8n → click the menu → Import from File.

  3. 3

    Select the downloaded JSON and import.

  4. 4

    Set up credentials for each node that requires them.

  5. 5

    Click Execute Workflow to test, then activate.

Setup guide

Setup guide included

Purchase to unlock the full step-by-step guide

Related N8n workflows

Monitor and forward Microsoft email messages automatically

Automatically monitor your Microsoft email for new messages and forward them to designated recipients, ensuring you never miss important communications.

Free

Readable workflow export & deployment pipeline for multi-environment CI/CD

This n8n workflow template uses community nodes and is only compatible with the self-hosted version of n8n. Export workflows with readable names, tagged for different environments To ensure understandable workflow exports, ease of use in delivery pipelines, and a better developer experience, this workflow helps with exporting workflows. Inner workings - First, the workflow ensures that the directory structure for storing the workflows is correct. - Exports all workflows. - Next, it processes al

Free

Sap service layer login

This minimal utility workflow connects to the SAP Business One Service Layer API to verify login credentials and return the session ID. It's ideal for testing access or using as a sub-workflow to retrieve the B1SESSION token for other operations. ++⚙️ HOW IT WORKS:++ 🔹 1. Trigger Manually The workflow is initiated using a Manual Trigger. Ideal for testing or debugging credentials before automation. 🔹 2. Set SAP Login Data The Set Login Data node defines four key input variables: sapurl: Base URL

Free

Create animated illustrations from text prompts with Midjourney and Kling API

What does the workflow do? This workflow is primarily designed to generate animated illustrations for content creators and social media professionals with Midjourney (unoffcial) and Kling (unofficial) API served by PiAPI. PiAPI is an API platform which provides professional API service. With service provided by PiAPI, users could generate a fantastic animated artwork simply using workflow on n8n without complex settings among various AI models. What is animated illustration? An animated illustr

Free

Validate Seatable webhooks with HMAC SHA256 authentication

Validate Seatable Webhooks with HMAC SHA256 Authentication This mini workflow is designed to securely validate incoming Seatable webhooks using HMAC SHA256 signature verification. 🔐 What it does: - Listens for incoming Seatable webhook requests. - Calculates a SHA256 HMAC hash of the raw request body using your shared secret. - Compares the computed hash with the x-seatable-signature header (after removing the sha256= prefix). - If the hashes match: responds with 200 OK and forwards the request

Free

Automatically upload email attachments to your FTP server

Every time you receive an email with an attachment, Make will automatically save the attachment to a selected FTP folder.

Free

Enhance your workflow with 2Ndmoises_Generator AI

Enhance Your Workflow with 2NdmoisesGenerator AI This n8n workflow integrates with Replicate’s moicarmonas/2ndmoisesgenerator model to generate custom outputs based on your prompt. It handles authentication, triggers the prediction, monitors progress, and processes the final result automatically. --- 📌 Section 1: Trigger & Authentication ⚡ On Clicking ‘Execute’ (Manual Trigger) Purpose: Start the workflow manually whenever you want to run it. Benefit: Great for testing or running on-demand wit

Free

Automate UGC video creation with Sora 2, OpenAI, and Gemini

In this tutorial, I’ll show how to create UGC (User Generated Content) videos automatically using n8n and Sora 2. This workflow uses OpenAI to generate detailed prompts and Sora 2 to produce realistic UGC-style videos that look natural and engaging. Who is this for? Marketers and social media managers scaling short-form video content Agencies producing branded or influencer-style content Content creators and freelancers automating their video workfl

Free

Reviews

No reviews yet

Be the first to buy and share your experience.

Leave a review

Sign in to share your experience with this workflow.

Log in to review
Free
No ratings yet

Create a free account to purchase workflows.

  • JSON blueprint — instant download
  • Setup guide PDF included
  • 5 downloads · valid 30 days
  • Works with n8n

Need help setting this up?

Book a 3-hour live setup session with an Agility consultant.

₹2,499/ session
3 hrs · video call
  • Configure live on Google Meet / Zoom
  • Free follow-up if workflow has defects
  • Platform expert assigned to you
Book installation session
Free