Blog Posts

These blog entries are meant to showcase some of the @get-set-fetch/scraper capabilities.

In no particular order, each post implements a scraping scenario I’ve encountered while browsing relevant topics on stackoverflow, reddit and such. Some of them are not that interesting but do illustrate core scraper concepts. Source code for all posts is available in the github repo under /examples.

How to Generate a Sitemap

Follow and extract all html links from a site.
Override default plugins and use a custom exporter to generate the sitemap based on the scraped URLs.