PubDelta

About PubDeltaBot

PubDeltaBot is PubDelta's crawler. It identifies itself as Mozilla/5.0 (compatible; PubDeltaBot/0.1; +https://pubdelta.com/bot).

It reads files that publishers make public for the ad industry, /ads.txt, /app-ads.txt and exchanges' /sellers.json, plus the homepage (or one article page) and the scripts that page loads, so it can record changes to a site's advertising setup.

It requests each site about once a day, with no more than a few dozen requests per visit. It doesn't log in, submit forms, run ads or execute JavaScript. Sites that block it are recorded as blocked and are not retried in other ways.

To ask about the crawler, or to have your site excluded, email bot@pubdelta.com.