How did Google index this site and access pay sites? You can be sure that Google did not pay any registration fees to access this content on pay sites. Instead, the webmasters of that particular site let Google in so that they can get more visitors through Search engines such as Google.
When Google needs to index websites, it does through an automatic robot known as the Googlebot which crawls the internet, looking for information to add to the Google database and using Google’s PageRank algorithm, you are returned the most relevant results for your search query and are ranked accordingly based on a number of factors.
So, how to access pay sites?
Well, we are going to disguise our browser as the Googlebot. Every browser such as Mozilla Firefox, Internet Explorer or Opera have a unique signature which identifies them. This is known as the useragent of that browser. For example, if you wish to find out what browser you are using, you can go to DNS Stuff, which will tell you what browser you are using and other information which it extracts using the user agent of your browser.
Access Pay Sites using Mozilla Firefox
If you are using Internet Explorer, I would highly recommend you download the latest Mozilla Firefox browser which is more secure and much faster.
Once you install the user agent for your browser, close and restart your browser. Go to Tools –> User Agent Switcher –>Options –> Options –> User Agents
Under User Agents, click add and add the following information as shown from below
Access Pay Sites for free using Opera
Changing the user agent is easy, to do this in Opera you have to uses these settings:
User Agent: Googlebot/2.1 Compatible: http://www.googlebot.com/bot.html
Access Pay sites for free using Internet Explorer
Internet Explorer users you will need to change the registry entries, to do this open notepad and copy this into it:
Windows Registry Editor Version 5.00 [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Agent] @=”Googlebot/2.1″ “Compatible”=”+http://www.googlebot.com/bot.html”
Then save it as ua.reg and double click on it.
To revert the changes back, you will need to do the same but this time copy this in:
Windows Registry Editor Version 5.00 [HKEYLOCALMACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Agent] @=”Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)”
Save as oua.reg and double click.
To see if it has worked go here and your browser should now be Googlebot v2.1If you liked this article, click here to buy me a beer!