Skip to content
GIRIVON
Infrastructure+
Systems+
Components+
Computing Devices+
Solutions+
Compute Tools+
Knowledge+

GIRIVONPriceBot

GIRIVON keeps its prices competitive by checking public product pages for the products it sells. This page explains what the crawler does and how to control it.

Identification

Requests carry the User-Agent GIRIVONPriceBot/1.0 (+https://www.everything.support/bot). The robots.txt product token is GIRIVONPriceBot.

What it fetches

  • robots.txt, sitemaps, and public product pages for products in the GIRIVON catalogue — nothing behind a login, cart or checkout.
  • Only the published price, currency, MRP, stock status, condition and product identifiers on the page.
  • No personal data, reviews or images are collected.

How it behaves

  • Obeys robots.txt (RFC 9309), including Crawl-delay; if robots.txt cannot be read because of a server error, it fetches nothing.
  • One request at a time per site, with a minimum delay of several seconds between requests and a long back-off after errors or rate limiting (HTTP 429/503).
  • Never attempts to get around CAPTCHAs, logins, paywalls, access controls or anti-bot protection — a blocked page is simply skipped.

Limiting or blocking it

To stop it entirely, add to your robots.txt:

User-agent: GIRIVONPriceBot
Disallow: /

Changes are picked up within 24 hours. For any other request, contact GIRIVON support.