Guard Dog being scraped - site ranks for your posts

[WCD Admin]

Hi

hxttp://affiliate-start.biz/ is scraping the posts here, re-posting and getting ranked pretty high, and quickly.

xxxhxtp://www.google.com/search?q=who+is+c-planet+casinos&hl=en&client=firefox-a&hs=QUQ&rlz=1R1GGGL_en___US359&ei=91DxTNa1DJCosAPgwrW-Cw&start=10&sa=N

 

[bc518]

My websites were scrapped all around on the internet. I can do nothing because all are in Chinese. There is no GPWA, or CasinoMeister. And All operators just sit and don't help.

You imagine how worse Asian online gambling market is.

 

[mattsgame]

Hi all

Can someone please explain to me how you can check if your site has been scrapped?

Cheers
Matt

 

[Daera]

They sure are.

Stuff like this really pisses me off.

Here's the domain registrants profile on blogger I think. xxxhttp://www.blogger.com/profile/06617045053348744806

 

[WCD Admin]

Can someone please explain to me how you can check if your site has been scrapped?

Just copy part of the original text of your site, and paste it into google and see if anyone besides you shows up for exact matches of highly unlikely phrases.

 

[Simmo!]

Actually two things here:

Firstly, the "affiliate-biz" site appears to be linking back to AGD on each article. I think this is because, secondly, it is calling the RSS feed that AGD (and most vB forums) supplies which contains just a limited portion of each thread.

Assuming that's right, that isn't scraping, shouldn't harm the site through duplicate content and seems like a legit use which will also have some benefit to AGD.

 

[Aussie-Dave]

My websites were scrapped all around on the internet. I can do nothing because all are in Chinese. There is no GPWA, or CasinoMeister. And All operators just sit and don't help.

You imagine how worse Asian online gambling market is.

Well actually you can do something yourself.

After seeing a multitude of suss bots in my one of my sites log files and having my WP infested with viagra links...I've implemented the use of mod_geoip. (will not work if mod_geoip is not installed on Apache)

I've set it up (.htaccess) to only allow the Countries listed, all others get a 403 error.

<IfModule mod_geoip.c>
#Allow access from the following countries only
#Australia
SetEnvIf GEOIP_COUNTRY_CODE AU AllowCountry
#United Kingdom
SetEnvIf GEOIP_COUNTRY_CODE UK AllowCountry
#United States
SetEnvIf GEOIP_COUNTRY_CODE US AllowCountry
#Canada
SetEnvIf GEOIP_COUNTRY_CODE CA AllowCountry
#New Zealand
SetEnvIf GEOIP_COUNTRY_CODE NZ AllowCountry
Deny from all
Allow from env=AllowCountry
</IfModule>

Sure cuts down on the bandwidth of bots like sos and baud spider which do not follow robots.txt instructions. It's also eliminated the the attempted hacks coming from the hot spots.


Cheers



Dave

 

[Guard Dog]

Simmo is right and I have been aware of them for a couple months now. I'm not too worried as they are simply using the RSS Feed and linking back. I found them out when I began receiving 'pingbacks' and then I checked the URL.

 

[WCD Admin]

That's legit? To do that without permission via a v-bulletin option? Seems like with permission is cool. Seems like powerful sites might possibly pull quickly enough and outrank you sometimes?

 

[Simmo!]

That's legit? To do that without permission via a v-bulletin option? Seems like with permission is cool. Seems like powerful sites might possibly pull quickly enough and outrank you sometimes?

vBulletin has the option to turn RSS on or off. Its off by default I think. A number of vB owners turn it on because it is a useful way to get links and while you can argue links vs ranking, there is an argument that says if a well-ranking site links back to you via your RSS feed those links are more valuable than from a low-ranking site.

Another advantage is that the more sites that link in to your content via the RSS the more authority you'll gain so in theory you should end up ranking highest as time progresses. Plus it has the side-effect of sending Googlebot round more often so your content starts to get indexed quicker.

I use this method on one or two of my own satellite blogs to send links and visitors through to one of my central sites. My satellite blog started by ranking higher but now the main site is catching it up.

 

[Daera]

Well actually you can do something yourself.

After seeing a multitude of suss bots in my one of my sites log files and having my WP infested with viagra links...I've implemented the use of mod_geoip. (will not work if mod_geoip is not installed on Apache)

I've set it up (.htaccess) to only allow the Countries listed, all others get a 403 error.

<IfModule mod_geoip.c>
#Allow access from the following countries only
#Australia
SetEnvIf GEOIP_COUNTRY_CODE AU AllowCountry
#United Kingdom
SetEnvIf GEOIP_COUNTRY_CODE UK AllowCountry
#United States
SetEnvIf GEOIP_COUNTRY_CODE US AllowCountry
#Canada
SetEnvIf GEOIP_COUNTRY_CODE CA AllowCountry
#New Zealand
SetEnvIf GEOIP_COUNTRY_CODE NZ AllowCountry
Deny from all
Allow from env=AllowCountry
</IfModule>

Sure cuts down on the bandwidth of bots like sos and baud spider which do not follow robots.txt instructions. It's also eliminated the the attempted hacks coming from the hot spots.


Cheers



Dave

For tech illiterate people like me, you can also try what I use... a free web site that gives you .htaccess code to block ip ranges by country. It's called block a country

It seems to help me keep some troublesome countries away from our forum.