Task

Allowed

2 services carry this tag in their source record. Tags come from the provider, not from us — a tag is a claim about what the service does, not proof that it does it well.

robots-allowed-for-bot x402 REST

Is a specific bot allowed to fetch a URL? Fetches the site's robots.txt and evaluates the path for the named user-agent (GPTBot, ClaudeBot, Googlebot, Bingbot, CCBot, PerplexityBot or any token), returning allowed/disall...

intel.rallylive.ca AI Models & Inference checked 2026-10-27

0.01 USDC per call per call

crawl-allowed-check x402 REST

Is a URL crawlable? Fetches the site's robots.txt and evaluates the given path for a specific user-agent (Googlebot, GPTBot, ClaudeBot, Bingbot or any token; default *), returning allowed/disallowed, the matching rule, t...

intel.rallylive.ca Search & Research checked 2026-10-27

0.01 USDC per call per call

Related tasks

Workflow Planning Sector Writing Weather Data Game Development Crypto Data Software Security Learning Economic Research Retail Operations Configuration Quality News Intelligence