If you are operating a no cost web proxy and do not use a robots.txt, you may perhaps discover problems coming your way from other angry webmasters claiming that you have stolen their internet content material. If you do not comprehend this, then at least bear in mind this term “proxy hijacking” effectively. You see, when a proxy user utilizes your no cost net proxy is utilised to retrieve an additional website’s contents, these content material are getting rewritten by the proxy script and seem to be hosted on your proxy web site automatically. What used to be on other internet sites now becomes your content soon after some proxy users visited those third celebration web sites.
Next, you have search engine bots from Google,Yahoo and MSN and so on crawling by means of your proxy sites content material and indexing those automatically designed or so known as stolen content and associating those content material to your proxy site. When the actual owners and authors of these content do a search on search engines and discover these content being listed on your web proxy (and not on their personal websites), they turn angry and get started issuing abuse emails to your hosting provider and to the search engines. Your proxy web page will finish up becoming removed from the search engine outcomes and that may perhaps mean a good loss of internet website traffic and earnings for you.
omegaproxy will also suspend your hosting accounts although this is not likely for specialized proxy hosting providers that are employed to handling such complaints and know that the true bring about of the proclaimed abuses. If you are using AdSense or any other marketing networks for monetizing your web proxy, these complainers might even go as far as to attempt and get your AdSense accounts banned by report that you are a spammer that is using duplicate content material.
If you do not know what web proxy scripts you are working with but you know you got them cost-free, then most most likely you are using either of the three massive proxy scripts: CGI Proxy, Phproxy and Glype. For comfort, we present a sample robots.txt that performs with their default installations:
User-agent: *
Disallow: /browse.php
Disallow: /nph-proxy.pl/
Disallow: /nph-proxy.cgi/
Disallow: /index.php?q*
Copy the above supply code into a robots.txt and upload it to the root directory for every single proxy web-site. Building correct robots.txt files for your proxy websites is an normally forgotten but critical step for several proxy owners, particularly those that personal significant proxy networks consisting of hundreds of internet proxies.
We are sharing all the little stuffs we picked up although running a lucrative proxy network of 800+ net proxy servers. Click over to our small cost-free proxy websites to read extra and join our ventures. We have nothing to sell, but you could get a headache though as we unload tons of insider data. A lot more function for you in all probability to boost your proxy organization for newbies.