Compliance & responsible scraping

We're transparent about what YakSpider does and how it handles data. We won't claim certifications we don't hold — here's the honest posture.

How we operate

  • robots.txt is honored by default; overriding it is an explicit per-spider choice.
  • Politeness: per-host rate limits and per-target throttles keep crawls gentle.
  • Pay-on-success: blocked and failed fetches are free — no incentive to hammer a site.

Your data

  • Results and credentials are scoped to your account; API keys are stored hashed.
  • Connector secrets can live in your account secret store, referenced by name.
  • Run data follows your plan's retention window; you can delete spiders and runs anytime.

Using YakSpider responsibly

You're responsible for scraping only what you're permitted to, respecting site terms and applicable law (including data-protection rules for personal data). We provide the tools; you own the use.

Questions? compliance@yakware.com