CysmosBot

CysmosBot is the web crawler of Cysmos, a software company in Austria. Its requests carry the User-Agent

CysmosBot/1.0 (+https://cysmos.bot/cysmosbot)

What it fetches

The public price lists of domain registrars: what a domain extension costs to register, renew and transfer. Plain HTTP requests only (no browser, no JavaScript), at most one request at a time per site. It does not log in, fill in forms or follow links outside the price pages.

How often

Once a day. The run starts between 02:30 and 03:00 UTC.

robots.txt

CysmosBot reads /robots.txt before it fetches a price page and honours it. Its robots.txt token is CysmosBot: rules in a User-agent: CysmosBot group apply to it, otherwise those for User-agent: *. A robots.txt that answers with a server error (5xx) or cannot be reached counts as "disallow everything"; one that answers 404 or another 4xx allows everything. Crawl-delay is not read.

How to block it

Add to your robots.txt

User-agent: CysmosBot
Disallow: /

or write to us, and we remove your site from the list.

Contact

Questions, problems or abuse reports: bot@cysmos.email. Please include the time (with time zone) and the URL that was requested.