• On TechRepublic: Windows 7 report card: Hits and misses
May 6, 2009 10:57 PM PDT

Twitter Search to dive deeper, rank results

by Rafe Needleman
  • Font size
  • Print
  • 19 comments

Correction: Santosh Jayaram's title at Google has been corrected.

Twitter Search will become a lot more useful soon, the microblogging site's new vice president of operations said Wednesday night.

Santosh Jayaram, who until recently was manager of search quality operations for Google, was on a panel I was moderating in the evening. During the panel and later in a one-on-one discussion, Jayaram confirmed that Twitter Search, which currently searches only the text of Twitter posts, will soon begin to crawl the links included in tweets and begin to index the content of those pages.

Santosh Jayaram, Twitter vice president

(Credit: Rafe Needleman/CNET)

This will make Twitter Search a much more complete index of what's happening in real time on the Web and make it an even more credible competitor to Google Search for people looking for very timely content.

Twitter Search will also get a "reputation" ranking system soon, Jayaram told me. When you do a search on a "trending" topic--a topic that is so big it gets its own link in the Twitter.com sidebar--Twitter will take into account the reputation of the person who wrote each tweet and rank the search results in part based on that.

Jayaram did not say precisely how reputation will be calculated; he indicated that engineers are still figuring that out. But this, again, will make Twitter Search more valuable.

Currently, if you search for a hot topic on Twitter, the results may be swamped by re-tweets and low-value content from hundreds or thousands of other users. A ranking system will help a great deal. See "Twitter search is broken" and "Three start-ups attack Twitter Search."

I'm looking forward to these changes.

Also, here is a real-time search story from Jayaram, which he used to illustrate the immediacy of Twitter Search during the panel discussion. He told of being in the Twitter offices in San Francisco on March 30, when the Twitter engineers noticed that the word "earthquake" had suddenly started trending up. They didn't know where the earthquake was.

Several seconds later, their building started to shake. The earthquake had been in Morgan Hill, 60 miles south of San Francisco, and the tweets about the shaker reached the office faster than the seismic waves themselves.

Rafe Needleman writes about start-ups, new technologies, and Web 2.0 products, as editor of CNET's Webware. E-mail Rafe.
Add a Comment (Log in or register) (19 Comments)
  • prev
  • 1
  • next
by grantkuo May 6, 2009 11:49 PM PDT
I wonder what kind of impact it will have over 3rd party twitter search engines
Reply to this comment
by wmfischer May 7, 2009 3:59 AM PDT
We've been combining semantic search capabilities with crawling the URL's within tweets for our vertical twitter search Ap http://twitterjobsearch.com and believe that it's essential to deliver relevancy.

Bill
@williamfischer
by xlhit May 7, 2009 10:23 AM PDT
As a developer of XLHit.com, a real-time auto-translating Twitter and FriendFeed search engine, this is great news, since it improves Twitter while letting us focus on what we do best, translated language search.
by mikeabundo May 7, 2009 3:27 AM PDT
For this to be truly representative of what people are linking to in real-time, Twitter will have to expand its global audience.
Reply to this comment
by christian_anderson May 7, 2009 9:13 AM PDT
I'm sure Twitter will represent it as what Twitter users are doing and not extrapolate it to say it is what all web users are doing -- at least for starters.
by AGORACOMgt May 7, 2009 5:05 AM PDT
I'm really looking forward to the reputation ranking system. Our reputation system was the key to our success. AGORACOM is an online community for small cap investors and public companies. As you can imagine, before we came along, discussion forums for small cap stocks were a cesspool.

Once we implemented a reputation and ranking system, investors left other sites for the serenity of our signal:noise ratio. Last year, we had 1.3 million uniques, 7.98 million visits and 97 million pages.

The relative effect on Twitter should be equally spectacular.

Regards,
George
Reply to this comment
by monkeyfun14 May 7, 2009 5:56 AM PDT
Where is Twitter getting the money to fund these projects?
Reply to this comment
by michaelorlinski May 7, 2009 6:04 AM PDT
makes sense as in the last two months http://tweetmeme.com/ has KILLED it with new visitors.
Reply to this comment
by Edw3rd May 7, 2009 8:13 AM PDT
Just what we need, another reputation ranking methodology for wanna-bee's and SEO conslutants to game.
Reply to this comment
by varunmobile May 7, 2009 8:46 AM PDT
This is great news ..

I think Google will partner with Twitter for Contextual Ads .

Also this is going to make twitter spam go down

http://varunkrish.com/twitter-readying-real-time-google-like-search-contextual-ads.html
Reply to this comment
by searchmotive May 7, 2009 9:18 AM PDT
I currently run an online search service at searchmotive.com which (in part) relies upon Twitter's search API. I am pleased to her the news of their upcoming improvements to their search as it will have a positive impact on mine. BTW, I'd welcome feedback from anyone regarding what could be done to make my service more useful for all. Thanks!

- Jason Gregory
@jag959
searchmotive.com
Reply to this comment
by colin_surprenant May 7, 2009 10:27 AM PDT
I think Twitter doesn't have a choice to introduce such a reputation rating on user account to fight spam that will inevitably hit the real time search where you can't just unfollow users. It is just a too easy to craft spam tweets based on hot topics and hide funky spam urls behind short urls. I recently blogged about this on http://eventuallyconsistent.com/blog/2009/04/the-next-spam-wave-will-come-from-twitter-real-time-search/

Colin Surprenant
@colinsurprenant
http://eventuallyconsistent.com/blog/
Reply to this comment
by lonestarState May 7, 2009 2:08 PM PDT
Anyone wanting to build an on-demand search engine can use BuildaSearch.com. They just released BAS (BuildaSearch Advanced Search) . The cool thing is a real search engine can be built in a matter of minutes using the cool web service.
Reply to this comment
by AndrewRich May 7, 2009 4:54 PM PDT
How about letting you search past one month ago? That might be nice.
Reply to this comment
by KeywordIntent May 7, 2009 10:03 PM PDT
This is very exciting. A whole new practice of optimizing content for Twitter Search has been born. It's another item to add to the SEO To Do List.

Jacqui Jones
www.keywordintent.com
Reply to this comment
by basebot May 8, 2009 3:27 AM PDT
With luck, this will be the first of a number of services that help people to use Twitter based on reputation. It would make Twitter much more useful if I could automatically eliminate the list-builders and spammers. Perhaps I could set my own criteria, and set reputations the way I want them?
Reply to this comment
by kevink1407 May 8, 2009 10:38 AM PDT
Now you can buy and sell twitter accounts. http://www.twitteraccountsforsale.com
Reply to this comment
by Sciengineer May 8, 2009 3:52 PM PDT
Was at the TiEcon Tweetup Event Wed night. Was in splits when @rafe remarked that everyone's (Facebook, Linkedin, etc.) really trying to be twitter - in response to someone's query 'What's with this obsession for status updates?'.

The TiEcon Tweetup was a fun event. While catching up with @allenb, @rafe, and @santojay was fun, I think Reid's keynote is gonna be super interesting.

Amit Bakshi compiled some goodies on his observations from the Tweetup discussion:
http://blog.tiecon.org/twitter-linkedin-execs-face-off-at-tiecon-tweetup/
Reply to this comment
by MarshallClark May 18, 2009 11:21 AM PDT
Interesting first step. Match this with third-party spidering limitations on Twitter reputation criteria and they'd have a nice competitive advantage over Google. Not a Google-killer yet by any means, but the start of a platform to build one from. Rock on Santosh!

Marshall Clark
Group Director, Search
Organic, Inc.
Reply to this comment
(19 Comments)
  • prev
  • 1
  • next
advertisement

About Webware

Say No to boxed software! The future of applications is online delivery and access. Software is passé. Webware is the new way to get things done.

Add this feed to your online news reader

Webware topics

Inside the Apple, er, Microsoft Store

Although Redmond's foray into retail bears a big resemblance to Apple's approach, Microsoft has added some distinctive features to draw casual PC buyers and techies alike.

Big marketing budget drives Moto Droid sales

Verizon and Motorola are spending big bucks--$100 million--on marketing the new smartphone, and it looks like it will pay off with 1 million devices sold by year's end.

Inside CNET News

Scroll Left Scroll Right