CityBotMagicBot
CityBotMagicBot reads public pages on local business websites to record services, hours and published prices.
- User agent contains
CityBotMagicBot. - Obeys robots.txt. To opt out:
User-agent: CityBotMagicBot/Disallow: / - Reads at most a handful of pages per site (home, services, prices/menu, contact), one request at a time, and caches results for a week.
- Never submits forms, logs in, or reads anything behind a login.
Questions or removal requests: hello@citybotmagic.com.