• On GameSpot: Handheld Xbox coming...eventually.
June 25, 2009 4:00 AM PDT

Twitter search sites: The three best, and all the rest

by Rafe Needleman

Twitter's own search engine.

(Credit: Screenshot by Rafe Needleman/CNET)

To follow what's happening in the real world, you need real-time search. Google doesn't have it (yet). Neither do Bing nor Yahoo. But a number--a large, growing number --of new search services scan Twitter and other sites in nearly real time, and will find for you the absolute latest update from the real-time social Web. I looked at more than two dozen products that search Twitter (and other sources) to find the best tools for uncovering the beating pulse of whatever topic you may be interested in.

To set the stage, let's look at Twitter's own search service. It's not bad. It's simple to use, presents results in a very clear way, and does a good job of balancing users' needs to see results in real-time with their inability to actually read the stream of tweets flying by: It updates a counter at the top of the page as new tweets that match your search come in, but you have to hit a link to actually see the updates.

Twitter Search also has an extremely good advanced query builder, and you can subscribe to search results via RSS.

The downside to Twitter search is that it's dumb, at least for now. Results are only sorted chronologically. There's no algorithm to give you the most read, most authoritative, most linked-to, or most re-tweeted items. And it only searches Twitter.

There are three services that do a much better job than Twitter Search, and several others are also worth looking at for special cases. Here are the top three:

Best three real-time search services

Twazzup: As I've said before, Twazzup is a very useful and flexible Twitter search tool that provides almost all of what Twitter Search does itself, plus a few columns of algorithmically generated results such as most influential tweeters on a topic, related photos, and a great list of keywords based on your search results that you can use to refine your query.

Unfortunately, the Twazzup results page can be overwhelming to read, and it only searches Twitter (excusable for Twitter Search, not for other services).

Twazzup has a complex presentation, but it combines the best of real-time search with algorithmic results.

(Credit: Screenshot by Rafe Needleman/CNET)

Collecta (story) is a new real-time search service that scans Twitter and many other sources, including mainstream media sites (CNN, etc.) and blogs. Its best features are its super-clean and simple interface, and the fact that it lets you run multiple searches at once, so it's great for monitoring a bunch of topics during the day.

Collecta lacks an advanced query builder and I've found it's sometimes slow to get cooking on a query, but it is shaping up to be an extremely useful tool.

Collecta keeps your queries running even when you're not looking at them.

(Credit: Screenshot by Josh Lowensohn/CNET)

Scoopler is another deceptively simple real-time search product that, like Twazzup, combines raw chronological results with a column of results ranked by popularity. This service doesn't have access to the full Twitter "fire hose" of data, but it does use additional methods to try to pick up more content than the Twitter Search API provides--especially items that contain links. Scoopler also lets you keep three search queries pegged to your page for quick access (although it doesn't run them in the background like Collecta does).

Scoopler also scans Digg, Delicious, Flickr, and Indentica. It earns a spot on my top-three list due to its clear combination of raw and ranked results. (This paragraph has been updated from the original version of the story)

Scoopler gives equal weight to what's new and what's popular.

(Credit: Screenshot by Rafe Needleman/CNET)

Other good real-time search tools

There are several other real-time search products. Some are highly specialized, or have weaknesses that offset strengths, but many are still very useful for specific needs. For example:

OneRiot only searches items that have links in them. This provides a good built-in filter for finding a lot of good info on the Web, but OneRiot won't find text-only tweets. Save that limitation, it's a very strong service, with options to switch between ranked and raw results, a special tab for shared video links, and a nice clean design. OneRiot searches Twitter, Digg, YouTube, and other services.

Tweetmeme is a stellar tool for discovering what's hot on Twitter, since it's all about the act of re-tweeting. It's not a great search engine, though. See also DailyRT, which has a better search function, including the capability to search only within the network of people you follow.

Monitter gives you a multi-column view of real-time Twitter search results (with no ranking), which makes it useful for monitoring several queries at once. Its special trick is that you can easily filter results by the location that Twitter users report in their profiles.

Topsy does a very good job of helping you find the most influential people on the topic you're searching for. It ranks results by links to the items in question, which is useful if not exactly real-time. There's no option for "live" results.

CrowdEye gives you stats on your query, and popular links related to it, but the results page is static. It's useful if you want to see how a search query is trending over time.

Keep an eye on Itpints, Twitority, Twitalyzer Search, Twitmatic, and Yauba, which gave me uneven experiences but which could improve quickly. Some other engines search Twitter, but aren't designed to provide real-time results; see Tweefind, for example.

Also, Twitter clients like Tweetdeck and Seesmic Desktop, and specialized online Twitter management tools like CoTweet have search functions in them that may fit with your Twitter workflow.

As far as the big old-school search companies like Google, Yahoo, and Microsoft go: Don't count them out forever. I am 100 percent sure that they are all looking for ways to set their search offerings apart and have their eyes on some of these companies as acquisition targets. Why do you think there are so many start-ups chasing this problem, after all?

Rafe Needleman writes about start-ups, new technologies, and Web 2.0 products, as editor of CNET's Webware. E-mail Rafe.
Recent posts from Webware
Twitter, LinkedIn team up for self-promotion free-for-all
'Elf Yourself' returns with Facebook and Twitter power
Sneak peek: Xobni e-mail app for BlackBerry
More time needed for revised Google Books deal
With AdMob, Google seeks mobile-ad advantage
Closing chapter of Google Books saga near
Google to acquire AdMob for $750 million
After 5 years, Firefox faces new challenges
Add a Comment (Log in or register) (22 Comments)
  • prev
  • 1
  • next
by monkeyfun14 June 25, 2009 4:59 AM PDT
I hate the term real time search for the world wide web because it truly is not possible. To truly get the absolute lastest information out of the world wide web you would need a datacenter or several that can reindex the whole web in seconds.

With twitter it can be done because all of the tweets could probably realistically fit on a 320gb harddrive.
Reply to this comment
by Darcy_Bennett June 25, 2009 9:40 AM PDT
This is like complaining about the World Series because it does not include teams from Zimbabwe ... this is just shorthand for being able to get some sort of information even when it was published seconds ago.

At any rate, this is a good list. I've tried them all and each definitely has its pros and cons.

Of the list, I think Yauba deservces a second look, as while it does offer real time search, it offers a lot more than the others in terms of other features. The other search engines seem to me to be more complements to the big search engines, where Yauba conceivably could be a replacement.
by LisaQuinn June 25, 2009 6:01 AM PDT
I just wanted to bring another efficient search engine to the list, eZanga.com. Their search technology retrieves results from multiple search engines displaying only the most relevant results without duplication or overlap. eZanga provides alternative searches including how to videos, images, shopping results, and other keywords that specifically relate to your searched terms. This, of course, helps focus your topic, making information even easier to find. Check it out: http://www.eZanga.com.
Reply to this comment
by lucafiligheddu June 25, 2009 6:51 AM PDT
Rafe, Tweefind is not a realtime search, but based on the users' rank. Can you explain what sort of "uneven experience" you got? Thanks!

Luca Filigheddu
CEO
Tweefind.com
Reply to this comment
by rafe June 25, 2009 8:15 AM PDT
Updated the post. Thanks for the clarification.
by wavehandslikeclouds June 25, 2009 8:28 AM PDT
Twitter search searches Twitter, not the web.
Check out Skygrid (www.skygrid.com) for real time financial news. The search is by company names or by portfolios. News are clustered around events, very nifty. Very fast, too. The site (beta test by invitation) seems to be evolving fast.
Reply to this comment
by mkennedy66996693 June 25, 2009 10:11 AM PDT
Hi Rafe. Here's one more for "all the rest" list: http://dotnet.ubbuzz.com/

Michael
Reply to this comment
by javisarias June 25, 2009 2:29 PM PDT
Hi!

I'm the developer of itpints! thank you for adding it to the article.

I would like to read more feedback from you about the site.

Thanks!
Reply to this comment
by GregoryMartin June 25, 2009 2:50 PM PDT
I use TipTop to search Twitter and get fresher, more synthesized, and highly relevant results for my search queries. Fortunately for us, TipTop can unleash the value in this massive volume of information and address many types of user needs to help inform, make decisions, or provide answers through user generated content and referenced links. A search on TipTop for ?iran violence? http://www.feeltiptop.com/iranelections%20OR%20iran%20violence/ not only provides live search and weighted results for all the Tips (positive messages) and Pits (comments with negative sentiment) surrounding the topic queried, but also allows filtering of the thousands of messages by related concepts and categories. Where else can you get sentiment infused natural language search results for queries such as http://www.feeltiptop.com/so+you+think+you+can+dance. TipTop is pushing the envelope in this respect.
Reply to this comment
by Harrison912 June 25, 2009 10:39 PM PDT
I mainly use Twitter to socially market my safety and security web site so this information is very helpful. Thanks, Rafe.
Reply to this comment
by buscpae June 26, 2009 12:26 AM PDT
i also highly recommend

http://www.all140.com
Reply to this comment
by henrymackintosh June 26, 2009 2:49 AM PDT
NIce article but I feel you should have included http://twitterjobsearch.com in the list. It is a true real time search engine "that goes beyond the tweet".
Reply to this comment
by waterlevels June 26, 2009 4:34 AM PDT
Tweeting or not i think there is always a lot to learn about making the best of twitter.
Reply to this comment
by ssaikia June 26, 2009 6:31 AM PDT
TWITTER: DISCOVERY VERSUS SEARCH

It is interesting that experts distinguish between search and discovery.

I like the following DISCOVERY sites
- www.twubs.com
- www.bit.ly

As for SEARCH it's interesting that I have not found anything that I like a lot!
Reply to this comment
by wesley_davis2 June 26, 2009 8:37 AM PDT
I would throw in tweetnews too

http://tweetnews.me

It uses Twitter as a ranking signal for fresh news as opposed to just ranking tweets themselves. Gets you the reliability of news with the speed of Twitter.
Reply to this comment
by Dowlapalli June 27, 2009 5:36 PM PDT
"Google and Bling don't do it yet, but a growing number of new search services scan Twitter and other sites in nearly real time."

I believe its Bing not Bling. And yes it is good :-)
Reply to this comment
by lonestarState June 27, 2009 7:27 PM PDT
Earthoid.com offers twitter search via real-time and is 100% ajax!
Reply to this comment
by jeffgtr60 June 27, 2009 9:45 PM PDT
Google will sorta do real time. Bing on the other hand falls on it's face. The MJ event was the perfect time to see what Bing had in it. In a word. Fail. It's ok if you want to use search as entertainment, but if you just want to ferret out some information Bing is not your friend.
Reply to this comment
by elenaBRZ July 2, 2009 2:45 AM PDT
Hi Rafe,

Have you tried Microplaza? http://microplaza.com
Give it a try as noise vs signal tool for your own twitter network...

Greetings from Spain,

Elena
Reply to this comment
by Monika_Lorincz July 10, 2009 7:03 AM PDT
How about surchur.com? Our real time search engine not only shows twitter updates, but also incorporates one of the broadest selections of sources - blogs, news, pics, products and more. Experience the world in real time ;)

Monika Lorincz
http://surchur.com
Reply to this comment
by pradeepvs July 16, 2009 5:22 AM PDT
I use TipTop to search Twitter and get fresher, more synthesized, and highly relevant results for my search queries. Fortunately for us, TipTop can unleash the value in this massive volume of information and address many types of user needs to help inform, make decisions, or provide answers through user generated content and referenced links. A search on TipTop for ?iran violence? http://www.feeltiptop.com/iranelections%20OR%20iran%20violence/ not only provides live search and weighted results for all the Tips (positive messages) and Pits (comments with negative sentiment) surrounding the topic queried, but also allows filtering of the thousands of messages by related concepts and categories. Where else can you get sentiment infused natural language search results for queries such as http://www.feeltiptop.com/so+you+think+you+can+dance. TipTop is pushing the envelope in this respect.
Reply to this comment
by drburix02 August 8, 2009 2:14 AM PDT
Here's another brand new real-time search engine: Feedmil.com. Feedmil.com is a real-time feed search engine that can find quality streams as well as current hot streams for a topical query.
Reply to this comment
(22 Comments)
  • prev
  • 1
  • next
advertisement

About Webware

Say No to boxed software! The future of applications is online delivery and access. Software is passé. Webware is the new way to get things done.

Add this feed to your online news reader

Webware topics

After 5 years, Firefox faces new challenges

Mozilla helped reshape the Web since releasing Firefox 1.0 five years ago. Now it's got a reawakened Microsoft and Google Chrome to reckon with.

There's a map for that: GPS or smartphone?

Almost every handset comes with mapping software these days, but standalone GPS devices are becoming more affordable than ever.

Inside CNET News

Scroll Left Scroll Right