BotsketBot
The crawler behind Botsket, a product search for AI shopping agents.
It identifies itself as:
BotsketBot/0.1 (+https://botsket.com/bot)
What it reads
/robots.txt, before anything else.- The public WooCommerce Store API product list,
/wp-json/wc/store/v1/products, 100 products per request, trimmed to name, link, SKU, price, stock, categories, brand and the first image. - The site name from
/wp-json/. - A single product from the same API when an agent asks Botsket to re-check its price.
It never loads your pages, carts or checkout, and keeps no product descriptions. Now and then
we open a handful of product pages, as BotsketQA, to check that our prices match
yours.
How often
A full pass once a week, one request at a time per store with a 3-second pause between requests. Live price checks are limited to one request every few seconds per store.
Opting out
Add this to your robots.txt and your products leave the index on the next pass:
User-agent: BotsketBot Disallow: /
Or email hello@botsket.com with your domain and we remove the store within 24 hours.
Separate from our checkout test
The agent-checkout verdicts come from a different tool that walks a store's buying path in a browser, the way a shopping agent does. It runs rarely, a store at a time, and adds at most one product to a cart. It never places an order.
What we log
When agents or people use Botsket we record the query, the user agent and a salted hash of the IP address, to count usage. No accounts, no cookies.