Task

Crawl Permission

1 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.

PennyAPI Robots Permission Check x402 REST usage

Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live proven...

pennyregwatch.com Search & Research 4 calls / 30d checked 2026-10-26

0.001 USDC per call per call

Related tasks

Workflow Planning Sector Writing Game Development Weather Data Crypto Data Economic Research Software Security Learning Media Generation Business Data Configuration Quality