Mediapartners-Google Bot?
Version: 1.1a
Revision: 2.1 Build: 3
Mediapartners-Google Bot?
Introduction: when I was maintaining my website, I didn’t know that Google has a brother!
Well… it has a longer name and it’s part of Google Adsense. But, it will not add your website into their search engines.
Robot Name: Mediapartners-Google
Agent_String: Mediapartners-Google/2.x
Infos: Netblock Owned by Google
So, if you want to allow Google Adsense to crawl your website, you can easily add these two lines – straight into your “robots.txt” file.
Pretty simple,Eh?
User-agent: Mediapartners-Google* Disallow:
Notes: this changes will allow Google media to crawl your site and provide your webpages with the most “relevant Google Ads”.
Security Tips: its best if you block Media – Google from accessing your “cgi-bin”.
I don’t know why. But, its for the best, regarding to security.
User-agent: Mediapartners-Google* Disallow: /cgi-bin/
