reader.scrapemole.workers.dev · 5 listed services · provider site
Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-s...
Use when you need the outgoing links of one page (crawling, SEO audits, finding a contact/pricing/docs page, link building): fetches the URL live (respects robots.txt) and returns every http(s) link resolved to an absolu...
Use when you need the latest posts or headlines from a site, blog, newsroom, podcast or subreddit: give a feed URL or just the site URL (the RSS/Atom feed is auto-discovered from the page) and get normalized items with t...
Use when you need a link preview or page metadata: fetches the URL live and returns title, description, site name, canonical URL, language, Open Graph and Twitter card tags, preview image, favicon, author and publish dat...
Use when you need to read one public web page: fetches the URL live and returns its main readable content as clean Markdown (or plain text), with navigation, ads, cookie banners and boilerplate removed, plus title, bylin...
Provider identity is derived from the domain or repository in the source record. If two vendors share a host, they appear together here — that is a limitation of the data, not a statement about ownership.