Skip to content
Change language: EN
My learningAdd to Chrome

How do I turn a list on a web page into structured data?

7 minIntermediateUpdated October 12, 2026AWFlow 0.8.2

Short answer

Chain When Started, Get HTML from Link to download the page by its address, HTML Extract in list mode to read each item's title and link, and Display Object to show the data. The page doesn't need to be open. Change URL and Container Selector to point it at your own page, and add a field per value you want.

Install the ready-made templateOr build it step by step ↓
On this page
  1. Before you start
  2. Install the recipe
  3. Run it
  4. Fetch the page
  5. Pull out the items
  6. Show the data
  7. Run it and check the result
  8. Common problems

Before you start

The AWFlow browser extension
How to set it up

Install the recipe

Install the recipe and open it on the canvas. To import the file yourself, use Add Workflow › Import, choose the .awf and click Create & open. Then click Make it mine at the bottom of the canvas, tick the box and confirm, so you can edit it.

Run it

Node: When Started

When Started has no settings. Click Test Workflow on the canvas.

Run it in the AWFlow editorRun it in the AWFlow editor
Tip · Run it every morning with a Schedule trigger.

Fetch the page

Node: Get HTML from Link

Get HTML from Link downloads https://news.ycombinator.com and puts its HTML in html. The page doesn't need to be open.

Fetch the page in the AWFlow editorFetch the page in the AWFlow editor
Tip · Change URL to the page you want. Pages that need you to be signed in may return a login page instead.

Pull out the items

Node: HTML Extract

HTML Extract in list mode finds every .titleline and, inside each, reads the link text as title and its href as link.

Pull out the items in the AWFlow editorPull out the items in the AWFlow editor
Tip · Set Container Selector to one repeated item on your page and add a field per value you want (price, date, author).

Show the data

Node: Display Object

Display Object shows the items as a tree you can expand.

Show the data in the AWFlow editorShow the data in the AWFlow editor
Tip · Save them with Google Sheets or download them with Save as File.

Run it and check the result

Click Test Workflow. Open Show the data in the run results: you see about 30 items, each with a title and a link from the Hacker News front page.

Common problems

The list is empty

The site renders its list with JavaScript, so the fetched HTML has no items. Open the page and use Get All HTML instead.

Links are relative (/item?id=…)

The site writes them that way. Prefix them with the site address in an Edit Fields step.

The fetch fails in the web app

Some sites block requests from other origins; run it in the extension. See browser compatibility.

Collect only what you need, keep the run rate reasonable, and respect each site's terms of use.

Academy

Learn this properly: build it from scratch.

Short lessons with a quiz at the end of each module.

Open the Academy →

Skip the steps. Install the template.

Add to AWFlowGet the extension — free