Lesson 12 4 min
Check pages that aren't open
When you don't keep the page open, check it on a schedule instead, and keep only what's new.
Swap the trigger
Replace Element Change with a Schedule trigger, for example every hour. Then fetch the page with Get HTML from Link and read the value with HTML Extract in Single value mode, for example with the selector .price. The browser has to be open for the schedule to fire, but the page doesn’t.
Schedules only run for published workflows. To test, run it from the canvas.
Keep only what’s new
For lists, add Remove Duplicates after HTML Extract and turn on Also Compare Against Previous Runs. The node remembers what it let through before and drops those items on later runs, so each run reports only new items.
Waiting on a service
When another service needs time to finish a job, Poll Until checks a URL again and again until your conditions hold (Done) or a deadline passes (Timeout).
Key takeaways
- A Schedule trigger, Get HTML from Link and HTML Extract read a page you don't have open.
- The browser has to be open for a schedule to fire.
- Remove Duplicates with Also Compare Against Previous Runs keeps only new items.