Stock market daily digest with Bright Data scraping & Gemini AI email reports

Setup Guide

Define the schedule (days, times, intervals).

Replace sample stock data with your desired stock list (ticker, name, etc.) in JSON format.

Split Out the fields to have a clean list of the stocks to monitor

set keyword node Extracts the stock ticker from each item and sets it to the keyword property.

Financial times scraper Triggers the Bright Data Datasets API to scrape financial data. Set the node as below

Method: POST

URL: https://api.brightdata.com/datasets/v3/trigger

Query Parameters:

dataset_id: Replace with your Bright Data dataset ID.

include_errors: true

type: discover_new

discover_by: keyword

Headers:

Authorization: Bearer YOUR_BRIGHTDATA_API_KEY Replace with your Bright Data API key.

Body: JSON, ={{ $('set keyword').all().map(item => item.json)}}

Execute Once: Checked.

Get progress node Checks the status of the Bright Data scraping job if complete, or running

Setup:

URL: https://api.brightdata.com/datasets/v3/progress/{{ $json.snapshot_id }}

Headers:

Authorization: Bearer YOUR_BRIGHTDATA_API_KEY Replace with your Bright Data API key.

Get snapshot + data retrieves the scraped data from the Bright Data API. Pass the request as

URL: https://api.brightdata.com/datasets/v3/snapshot/{{ $json.snapshot_id }}

Query Parameters: format: json

Headers:

Authorization: Bearer YOUR_BRIGHTDATA_API_KEY Replace with your Bright Data API key.

Aggregate. Combines the data from each stock item into a single object

Update to sheet and add all items to This sheet. Make a copy before you can map the data

create summary node generates a summary of the scraped stock data using the Google Gemini AI model and notifies you via Gmail.

Setup:

Prompt Type: define

Text: Customize the prompt to define the AI's role, input format, tasks, output format (HTML email), and constraints.

Google Sheets. Appends the scraped data to a Google Sheet. This should be set to automap so as to adjust to the results found in the request