What's That Noise?! [Ian Kallen's Weblog]
Sunday January 08, 2006
Kudo's For Technorati's Anti-Spam Effort Props from Jeremy on our anti-blog spam efforts are certainly appreciated. I know we don't have a spam-free index, however the amount of spam we keep out of the index is truly astonishing. Our ping interface is deluged with a torrent of rubbish but we do our best to scrub the nasty stuff out of our update stream. The problem defies conventional mail spam or even blog comment spam analytic techniques as the structure of blog spam is very different. Deep examination of the content and structure across a pattern of web sites is often required to distinguish it as spam but in the end, the indicators are there. Most spammers' publishing behaviors are statistical outliers by nature; the numbers speak for themselves.
We have a lot to do, on this and on many fronts but we try to pay attention to the gripes as a measure of priorities. The kudos are nice, too!
( Jan 08 2006, 08:29:31 PM PST ) Permalink
![[Valid RSS]](/images/valid-rss.png "Validate my RSS feed")