Compliance & responsible scraping
We're transparent about what YakSpider does and how it handles data. We won't claim certifications we don't hold — here's the honest posture.
How we operate
- robots.txt is honored by default; overriding it is an explicit per-spider choice.
- Politeness: per-host rate limits and per-target throttles keep crawls gentle.
- Pay-on-success: blocked and failed fetches are free — no incentive to hammer a site.
Your data
- Results and credentials are scoped to your account; API keys are stored hashed.
- Connector secrets can live in your account secret store, referenced by name.
- Run data follows your plan's retention window; you can delete spiders and runs anytime.
Using YakSpider responsibly
You're responsible for scraping only what you're permitted to, respecting site terms and applicable law (including data-protection rules for personal data). We provide the tools; you own the use.
Questions? compliance@yakware.com