CysmosDataUpdate is the data downloader of Cysmos, a software company in Austria. Its requests carry the User-Agent
CysmosDataUpdate/1.0 (+https://cysmos.bot/cysmosdataupdate)
Requests to CDS Strasbourg (cdsarc.cds.unistra.fr, vizier.cds.unistra.fr) carry the
short form CysmosDataUpdate/1.0 without this address, because CDS refuses User-Agents that
contain "bot".
Published open datasets: catalogues, reference lists and mirrors of public data, downloaded from their providers' official download addresses into Cysmos' own data store. It fetches the specific files named in its list of sources (for a few datasets, such as a published image tile set, every file of that dataset), not whole websites: it does not follow links, log in or fill in forms. Plain HTTP requests only (no browser, no JavaScript).
Not as a continuous crawl: it runs when a developer or our build system refreshes the data. It keeps a local copy of every file and downloads a file again only once that copy is older than the period set for its source; many files are downloaded once and never again.
CysmosDataUpdate does not read /robots.txt: it requests only files that their providers publish
for download. To stop or slow it down, write to us (below).
Write to bot@cysmos.email with the file or address it requests and what you would like (fewer requests, a pause between requests, or no requests at all), and we change its source list accordingly.
Questions, problems or abuse reports: bot@cysmos.email. Please include the time (with time zone) and the URL that was requested.