Guides
Responsible use
Siftzo is for collecting public web data: prices, listings, articles, search results and other pages anyone can open without logging in. This page explains where the line is and what we do to keep it.
Your responsibility
You decide what to fetch and what to do with it, so you are responsible for having the right to do so. In short, and in full in the acceptable use policy:
- Collect public data only. Do not access pages behind a login unless you are authorized to.
- Personal data is regulated. If you collect it, you need a legal basis under the GDPR (or the law that applies to you), and you must handle it accordingly. Do not build profiles of people from scraped data without one.
- Respect the sites you collect from. Read their terms and robots.txt, keep your request rate reasonable, and do not use Siftzo to overload or attack a site.
- Do not use Siftzo to get around paywalls or captchas on sites that forbid it, to create accounts in bulk, to test stolen credentials or to buy up limited stock or tickets.
- Respect copyright and database rights in what you collect and publish.
What Siftzo does
- Public targets only. The API refuses URLs that point at private networks, internal hostnames or IP addresses that are not public, before any traffic is sent.
- A domain blocklist. Some domains are always refused with
403 target_not_allowed, such as government and banking sites and sites whose owners have asked to be excluded. - Abuse handling. Reports sent to [email protected] are checked against our request logs and acted on, up to suspending the account. A suspended account gets
403 account_suspendedon every request. - Limits on free accounts. Free credits go to one organization per person, and free accounts have low concurrency, which makes abuse expensive.
- Results are not kept. Sync results are passed straight to you. Async results are deleted after 24 hours. We keep request metadata (such as the target domain, status and credits) for billing and abuse handling, not page contents.
For site owners
If you see traffic from Siftzo that you think breaks these rules, or you want your site to be excluded, write to [email protected]. Include the domain, the time range and, if you have them, example requests. Requests through Siftzo do not carry a Siftzo user agent, so the time and target URLs are what help us find them.
Siftzo operates under EU law. When we receive a lawful request from authorities, we cooperate within what the law requires.