Sunday, September 02, 2007

Parasite hosting - Or why social networking sites need to review user generated content.

To directly see the list of highly ranked spammy users pages within reddit
From wikipedia: Parasite hosting is the process of hosting a site on some one else's server without their consent, generally for the purpose of search engine benefit.

One of the most competitive keywords which everyone wants to rank for is buy viagra online

On that and many other similar searches, you would start noticing that user pages of social bookmarking sites like reddit, get very prominent rankings.
These sites have a very high TrustRank and amazing authority scores. So even off topic pages are very easily ranked high for pages created on these domains.
I was playing with the sitexplorer python library I wrote. The user pages on the reddit domain outrank even the subreddit pages.
Using a little python I found that of the top 400 pages on the reddit.com domain, 102 are user pages of the form reddit.com/user/{username}/. All of these are pages promoting prescription pills like Viagra or Cialis.
(The python program [1]
List of the user pages in the top 400 pages on reddit)

How can the social bookmarking sites combat this?
1. Use a robots.txt. For reddit.com this can be as simple as using

User-Agent: *
Disallow: /user

2. Have kill words which are not allowed in the user names. This allows the pages to be indexed with facing parasite hosting.



import re
all_pages = []
for i in range(4):
start = i*100 + 1
results = get_page_data('YahooDemo', u'http://reddit.com', start = start, results = 100)
pages = [el['Url'] for el in results]
all_pages.extend(pages)

pat = '/user/([a-zA-Z0-9_]*)'
rep = re.compile(pat)
users = [rep.search(el) for el in all_pages]
users_ = [el.groups()[0] for el in users if el is not None]



List of the users on the reddit.com site. (These links are nofollowed).
[u'Buy_viagra_online_', u'BUY_VIAGRA_MEDS', u'CHEAP_VIAGRA_PRICE', u'ORDER_VIAGRA_NOW', u'tylerton', u'VIAGRA_ONLINE_CHEAP', u'Buy_viagra_online', u'DISCOUNT_VIAGRA_NOW', u'order_viagra_cheap', u'order_viagra_online', u'order_cialis_cheap', u'Viagra_', u'viagraagain', u'cialisagain', u'BUY_VIAGRA_ONLINEE', u'tramadolagain', u'phentermineagain', u'levitraagain', u'BUY_VIAGRA_ONLINE3', u'BUY_FLAGYL_ONLINE', u'CIALIS_LOWEST_PRICES', u'BUY_HOODIA_ONLINE', u'ORDER_VIAGRA_TODAY', u'Ephedra_Pills', u'Viagra_online', u'BUY_VIAGRA_ONLINE2', u'dans_movies', u'panda_movies', u'cialispills', u'BUY_VIAGRA1', u'Viagrapills_Online', u'phenterminepills', u'tramadolpills', u'free_porn_movies', u'phenterminepharm', u'Soma_Carisoprodol', u'cialispharm', u'viagraonline', u'Cheapest_Fioricet', u'Meridia_Diet_Pills', u'viagrapills', u'valiumpills', u'levitrapharm', u'cialis_buy', u'Buy_Percocet', u'viagrapharm', u'BUY_VIAGRA_MD', u'Tramadol_Hcl', u'Generic_Propecia', u'xanaxpill', u'BUY_LEVITRA_ONLINE1', u'tramadolpill', u'cialis_cheap', u'tramadolpharm', u'CIALIS_BEST_PRICES', u'ordertramadol', u'phenterminepill', u'order_levitra_med', u'orderxanax', u'cialis_online_drug', u'orderphentermine', u'generic_cialis_pill', u'ordercialis', u'CIALIS_ONLINE', u'BUY_VIAGRA_ONLINE1', u'online_buy_cialis', u'CHEAP_VIAGRA_PRICES', u'generic_levitra_pill', u'orderviagra', u'LEVITRA_SALE', u'CHEAP_VIAGRA_ONLINE', u'Order_Cialis_Online0', u'BUY_DISCOUNT_VIAGRA', u'order_cialis_online', u'BUY_VIAGRA_TODAY', u'VIAGRA_LOWEST_PRICE', u'CHEAP_VIAGRA_PILL', u'viagracialis', u'Suboxone', u'VIAGRA_BEST_PRICES', u'FDA_CIALIS_ONLINE', u'DISCOUNT_VIAGRA_A', u'cialistop', u'Buy_viagra_', u'phenermine', u'FDA_LEVITRA', u'phenterminetop', u'insura', u'viagrapharmacy', u'cialispharmacy', u'viagratop', u'levitrapharmacy', u'phenterminepharmacy', u'autoverzekering', u'discount_viagra', u'goba', u'levitratop', u'generic_cialis']
>>>

40 comments:

ggggg said...

http://www.allhookup.com - get laid right now!

Chuck said...

It is definitely easier to find out informative tidbits on the erectile dysfunction drug Viagra by inserting the keyword “Viagra” in the Google search tool bar. You can also log into theResources section of the website http://www.buy-viagra-with-us.com, and obtain comprehensive Viagra information.

如此的 said...

先告訴自己希望成為什麼樣的人,然後一步一步實踐必要的步驟。........................................

聊天室 said...

感覺很用心經營呢!鼓勵鼓勵........................................

怡如 said...

很喜歡你的部落格風格,期待你的更新!........................................

佩璇佩璇 said...

You may be only one person in the world, but you may also be the world to one person.............................................

水慧 said...

hello~welcome my world~<. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

NicolaSigel0508 said...

great msg for me, thanks a lot dude˙﹏˙

采瑩 said...

你不能和一個握緊的拳頭握手........................................

ZenaT_Pinter2284 said...

Gold will not buy everything...................................................

嘉花 said...

Nice post ~ 3Q..............................................................

明NathanA_Schulle said...

想要推動天下,先要發動自己。.............................................

MiyokoC_Rachal奕玲 said...

在莫非定律中有項笨蛋定律:「一個組織中的笨蛋,恆大於等於三分之二。」..................................................

Adit Creation said...

Nice blog it is maintained good and also have good post about Search Engine Optimization and Internet Marketing.

岳仲 said...

kk視訊內衣秀 免費情色av影片 情色小魔女自拍 免費情色影片無碼 qq美美色網免費看 ut辣妹哈啦視訊聊天室 34c美女寶貝視訊 ez聊天網 avdvd成人影城 aa台辣妹有約 34c玩美女人百分百貼影片區 一葉情貼圖片區 383 天下貼圖情趣 商品 一對多視訊大學生情人 gogo2sex視訊妹 線上免費視訊聊天 yam天空辣妹影音 視訊交友etude 比基尼辣妹 kk272視訊 A片-sex520 影音聊天室fm358 sex520 net視訊美女 080視訊聊天室how2 85st免費影片觀看 小弟弟成人娛樂網 辣妹視訊聊天室 90691 免費熟女人影片 g8mm 視訊小愛 比基尼美女的奶,玩美女人影音秀 383影音城a 情色視訊,貓貓論壇 啦咧華人視訊交友聊天室 38ga成人 辣妹有約溫泉 微風愛情館論壇aio 我愛78論壇影片 飯島愛免費影片 辣手美眉甜心寶貝直播貼片 免費a片觀看 視訊交友loveliness av影片下載 avhigh免費影片 限制性影片 hi5 tv 免費聊天情人fm358 a383girl影音城 亞洲視訊34c甜心寶貝直播貼片 免費聊天mmshow 南台灣視訊網愛聊天室

子名子名 said...

安心亞寫真top1069拓網交友做愛自拍免費情色影片寫真集美女正妹照片正妹貼圖正妹視訊250av女優免費影片旺來出品辣妹寫真鋼管秀旺來風情寫真秀-辣妹過招旺來風情寫真秀旺來蓬萊仙山寫真集 vcd旺旺仙貝的狂想境地早洩韭南籽早期歐美a片早期范冰冰照片早春小老婆日本三性影片美女 視訊洪爺sex免費看a片論壇秘密情人影音視訊網 bt成人網av一葉情貼影色網18 禁一葉情貼影入口女生自衛影片免費聊天女同志聊天室成人聊天室做愛影片網交聊天室性愛姿勢免費av影片觀看拓峰交友plus論壇hbo論壇一夜情視訊聊天室五分鐘護半身視訊美女激情網愛聊天室臺灣情色網

黃峻帆 said...

生活盡可低,志氣當高潔........................................

hernande said...

所有的資產,在不被諒解時,都成了負債..................................................

聖妃 said...

文章不求沽名釣譽,率性就是真的..................................................................

李威昌 said...

能猜得出女人真實年齡的男人也許耳聰目明,但肯定毫無大腦。哈哈!..................................................................

江婷 said...

要照顧身體歐~保重......................................................................

萱祥 said...

生存乃是不斷地在內心與靈魂交戰;寫作是坐著審判自己。....................................................................

淑娟淑娟 said...

成熟,就是有能力適應生活中的模糊。.................................................................

吳婷婷 said...

人有兩眼一舌,是為了觀察倍於說話的緣故。............................................................

珮君 said...

人生是故事的創造與遺忘。............................................................

婷珊 said...

越來越多人看你的部落格 要繼續加油喔 ..................................................................

吳婷婷 said...

這樣的情感,真是值得人羨慕............................................................

冠宇 said...

相見亦無事,不來常思君.................................................................

佳皓佳皓 said...

快樂,是享受工作過程的結果............................................................

d1gd21g231g21s said...

好的blog就是要回應!............................................................

琬安琬安 said...

take care yourself!! ^^............................................................

許惠吟許惠吟 said...

一個人的際遇在第一次總是最深刻的,有時候甚至會讓人的心變成永遠的絕緣。............................................................

偉林少菁林誠 said...

聰明人之所以不會成功,是因為他們缺乏了堅忍的毅力。..................................................

華汪昕 said...

做好事,不需要給人知道,雖然只是一件微不足道的事,但我相信,這會帶給我快樂。..................................................

佳陳容 said...

Pay somebody back in his own coin.............................................................

蔡曼鄭美玉屏 said...

做些小善事,說些愛的字句,世界更快樂。..................................................

思韓韓韓穎 said...

肯定與支持你!!!加油囉~..................................................

316 said...

知識可以傳授,智慧卻不行。每個人必須成為他自己。. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

佳張張張張燕張張張張張 said...

河水永遠是相同的,可是每一剎那又都是新的。..................................................

于庭吳 said...

加油!!! 很棒的分享~..................................................................