ArinaBot

The web crawler for Arina, an independent, privacy-first search engine.

ArinaBot visits public web pages to build Arina's own search index. We crawl politely, identify ourselves honestly, and respect your wishes. If ArinaBot is visiting your site and you have questions or concerns, this page tells you everything you need — including how to control or stop it.

How to identify ArinaBot

User-Agent	`ArinaBot/0.1 (+https://arina.directory/bot)`
Source hostname	`crawler.arina.directory`
Source IP	`89.149.242.229`
Operated by	vaicat B.V. (KvK 89360672), The Hague, The Netherlands

You can verify a request really comes from ArinaBot (and isn't an impostor spoofing our User-Agent) with a forward-confirmed reverse DNS check: the IP reverse-resolves to crawler.arina.directory, which forward-resolves back to the same IP.

Controlling ArinaBot with robots.txt

ArinaBot obeys the Robots Exclusion Protocol. To block us entirely:

User-agent: ArinaBot
Disallow: /

To block only part of your site, or to set a crawl delay:

User-agent: ArinaBot
Disallow: /private/
Crawl-delay: 10

We also honour page-level <meta name="robots" content="noindex"> and X-Robots-Tag headers.

Our politeness commitments

One or two connections per host at a time, with delays between requests.
We back off automatically if your server is slow or returns errors, and we honour 429 / Retry-After.
We cap how much we fetch from any single site, and crawl breadth-first across many sites rather than hammering one.
We never attempt to bypass blocks, paywalls, logins, or anti-bot measures.

Removal & contact

To request removal of your content from Arina, report a problem, or ask anything about ArinaBot, email abuse@arina.directory. For legal or data-protection matters, vaicat B.V. is the operator and controller; see the contact details on our legal pages.

ArinaBot · operated by vaicat B.V. · last updated 2026-06-05