July 13, 2006 1:19 PM PDT
Microsoft looks to foil Web spammers
- Related Stories
-
Spim, splog on the rise
July 6, 2006 -
Microsoft tool hunts down typo squatters
April 13, 2006 -
Blogosphere suffers spam explosion
April 11, 2006 -
Tempted by blogs, spam becomes 'splog'
October 20, 2005
Called Strider Search Defender, the tool is designed to dig out Web pages that are a front for spam Web sites, according to a paper published by Microsoft researchers on Thursday. These Web pages typically reside on blogging sites and other services that provide free Web space, the researchers said.
Spammers soil the Web with countless links to their spam fronts in order to gain a higher ranking in search engines. "By cleaning up Web search, hopefully we can discourage spammers from cluttering the Web with spam," Yi-Min Wang, principal researcher at Microsoft, said in an interview.
Microsoft's tool doesn't find spam the traditional way, by looking at the site's content. Instead, it turns the spammers' activities against them by using search engines to find links to potential spam pages. These links are often posted as comments on blogs, in online discussion forums and in guestbooks, also called "comment spam."
Search Defender starts with a list of confirmed spam Web addresses. A "Spam Hunter" part of the tool runs those addresses through search engines to find pages that link to the spam sites, using the "link:" query tag. Additional spam URLs found on those sites are, in turn, run through the Spam Hunter, resulting in a long list of potential spam sites.
Then, using another Microsoft research project, Strider URL Tracer, false positives are filtered out and a list of Web pages that redirect to spam sites is compiled. Strider URL Tracer actually visits each one of the Web addresses found by the Spam Hunter to see if it redirects to a secondary spam page.
"We use search engines to find them," Wang said. "Spammers are basically telling us: Here are my spam URLs."
Spammers use various online services to host spam fronts, including free Web hosting providers such as Tripod, Angelfire and Yahoo's Geocities, Microsoft said. Blogging services are also often abused, Google's Blogger at blogspot.com is especially popular, according to the research report.
"Our preliminary investigation shows that spam blogs hosted on blogspot.com appear to be particularly widely spammed and effective against search engines," the report said.
Microsoft's researchers are working with the MSN Search team to see how the search service could be cleaned up, Wang said. Additionally, he called on the Web community, especially the operators of blog and free hosting sites, to cooperate to combat the Web spam problem.
"In the end it is all about protecting the search engines. Because if the spam doesn't show up in any search engine result the spammer will not receive traffic," Wang said.
See more CNET content tagged:
spammer,
spam,
search engine,
researcher,
blogging
(MSR-TR-2006-97) is not new, just updated. I was first placed on the web several months ago, early April. It was discussed and link to on several blogs like this one. See the SEE ALSO link.
http://www.resourceshelf.com/2006/04/11/new-from-microsoft-research-strider-url-tracer-with-typo-patrol/
but this sounds like they will clean up the garbage.
Like if I search for dogs a site might say "dogs, poodles, dashunds, collies... with ads that say: if you want to see my ***** pay $29.95 per month"
a very short synopsis of the crass things I've seen anything that will clean it up will be welcome but what about the false positives? what about those sites that accidentlly get in and don't get filtered out? I think it is a very possible situation for a lawsuit that should not be thrown out.
BMR777
http://www.webringamerica.com