App GravityAppGravityBot
The crawler behind App Gravity's App Store market data. It identifies itself as AppGravityBot/0.1 (+https://appgrav.com/bot).
What it reads
Public pages on apps.shopify.com: the sitemap, app listing pages, their public review pages and category pages. It reads what any visitor can see: names, ratings, review text, pricing plans, categories, languages and listing media counts.
What it never does
It never visits search result pages or anything robots.txt disallows, never signs in, never submits forms and never fetches any site other than the Shopify App Store.
How it behaves
It reads and obeys robots.txt before every crawl and refreshes it daily. It makes at most one request per second, with random spacing, uses conditional requests so unchanged pages are not downloaded again, and backs off when the server asks it to slow down.
Contact
Questions or a request to change how it crawls: support@appgrav.com.