Buffer

All the easiest ways to search old tweets

by Dave Larson on August 11, 2010

Update: There is no free search product that is 100% reliable. Even just trying to see tweets written to you on a day-to-day basis can be problematic. Also, read about how, in July, 2011, Twitter changed how search works.
Update: To see the most tweets possible at Twitter.com, read “How to get Twitter.com to show you more tweets when you page down.”

Twitter’s default search only goes back a week—if that—and often chokes on multiple keyword searches. Fortunately, there ARE many great alternatives, and I’ve included a chart comparing the nine top tweet search engines below. For example, Topsy lets you search all the way back to May, 2008. Here are links to each of the nine (plus a few extra ones),  in order of what I’ve found most useful to least useful for general tweet searches (however, some are powerful in other ways)):

Searchtastic (went offline July 26, 2011)

  1. TwimeMachine
  2. SnapBird
  3. Topsy
  4. The Archivist (a service that lets you search Twitter for Tweets. Then you can create an archive, view it as a spreadsheet or download a .zip file and analyze, export and share the tweets. It displays some stat charts about the tweets.)
  5. TweetBoard
  6. Google Tweet Search with date option
  7. Google Realtime Search Update: Google has cancelled this service after coming out with their own social network
  8. TweetScan
  9. BackTweets
  10. FriendFeed
  11. Twitter Advanced Search
  12. Social Searching (claims search years back in Twitter or Facebook, doesn’t always work)
  13.  http://chirpcity.com searches local, city and keyword based trends and tweets.
  14. Research.ly announces you can access up to 1,000 days of Twitter conversations: http://bit.ly/hVxcbN
  15. The paid search companies @gnip and @DataSift will search ALL tweets for you.

Library of Congress tweet archive search

By searching Google using the “Updates” option you are searching the entire twitter archive. See the Google section below.

Review of all search methods

I’ve added a brief review below, which I’ll expand later. Before I do, would you let me know of any other tweet search engines you’ve found? I’ll update the chart and this review to include them. Would you also let me know of any problems you’ve had using these search engines? Of course, there are tons of alternative Twitter search engines out there, with a wide variety of features. See, for example, 30 Twitter Search Alternatives & Tools. And many Twitter clients have advanced Twitter search options.

All The Ways You Can Search Old Tweets


Note that very few of the search engines at this time appear to go beyond the 3200 Twitter API limit, as pointed out here by Adrienne.

Review of Tweet Search Engines

Searchtastic and Snapbird

First: Bookmark these two search engines! They are fantastic. And, sometimes one is running faster than the other one. These are the two best, no question. Searchtastic is often easier and faster for basic searches, but Snapbird is more powerful—and plenty fast most of the time. The options are pretty straightforward in both, so my suggestions is to play around with each of them. Note that you can search your DMs or any user’s favorites in SnapBird, and Searchtastic will export your search results to a spreadsheet. Great features!

BackTweets

This lets you see tweets that linked to any website address, e.g., see all the tweets that have included links to your blog. Twitter did not formerly offer this search service themselves, but now they do. But BackTweets will show you more results than Twitter’s search. Just paste any URL into BackTweets or search.twitter.com to see all the tweets that have included a link to that URL.

Topsy, Tweetboard & Friendfeed

These powerful tools are different from the others, and not search engines in the way you might expect. Topsy now lets you search all the way back to May, 2008! These three should all be part of your Twitter arsenal. Do this:

  1. Apply to join the Tweetboard beta.
  2. Sign up for Friendfeed so it will save your tweets,.
  3. Start experimenting with Topsy.

I love how Tweetboard will show me conversations from nearly two years ago on Twitter. Topsy’s strength is showing you which are the most important links tweeted for a particular search. Some of the links we share from TweetSmarter every week are found by searching Topsy for “Twitter.”

Tip: When you are looking at search results in Topsy, note the options at the bottom of it’s left-hand column, and along the top of the page.

Google

REPLAY: Google has several ways to find tweets, but I don’t find any of them very useful. They had an experiment called “replay” that let you see how frequently words were being tweeted. Although it is officially over, you can still access the replay features here (as of August 11, 2010). Note the date links under the search box. Play with those to see different date ranges.

UPDATES: For any Google search you do, you can click “Updates” in the left column (you may have to click “more” to see the options) to restrict your search results to tweets. While the keyword search is advanced, you are restricted to searching all tweets from all users.

CUSTOM:You can search for tweets from specific users, but Google has been eliminating most tweets. They used to show you a LOT of tweets, now there are very few results returned. The way to achieve this search is to enter the following into the Google search box:

site:twitter.com inurl:”USERNAME/status” SEARCH TERMS

For example, here is how you would search for any tweets from @TweetSmarter that contain the word “followers”

site:twitter.com inurl:”TweetSmarter/status” followers

There are other ways to do this, but Twitter has changed its URL structure a bit, so this is now the most accurate.

LISTS: You can do a similar search for Twitter lists in Google, which appears complete. Read more by clicking here and scrolling down to the section “Comprehensive index of all Twitter lists…on Google

TwimeMachine & TweetScan

You’ll probably find yourself using these least of all, because in each case there is another search engine that does it better. But let me know your experience!

Other tweet search engines

Know of others? Leave me a comment to let me know and I’ll update this post and credit you. I’ll be reviewing some of these in a future post:

Archive your tweets

There are a lot of services that you can subscribe to that will archive your tweets, and then there are options for searching them as well. If you haven’t signed up to any archive service yet, first join FriendFeed and let them save your tweets for you. I’m writing a separate post about tweet archive services that I’ll link to when it goes live, but in the meantime check out 10 Ways to Archive Your Tweets.

{ 67 comments… read them below or add one }

anyatwome November 17, 2011 at 8:23 AM

Hey! Thank you so much for this informations. I have a questions: Are there any news about searching old tweets? I am looking for tweets of a specific theme (#) on a specific month in the year 2009. Unfortunality the library of congress is not ready yet with the archive and the other aps. are not for my theme or closed down. I would need this for my diploma and would be very thankfull if there are some news about searching old tweets. Thanks in advance and: great idea the tweetsmarter…. Cheers anya

Reply

Dave Larson November 17, 2011 at 4:08 PM

The paid search companies @gnip and @DataSift will search ALL tweets for you.

Reply

Tom E. Turner December 2, 2011 at 10:56 AM

Searchtastic says…
Sorry we are shutting down the site because we do not have time to continue maintaining it.
Please contact us if you are interested in buying the code or the domain name.

Reply

Dave Larson December 2, 2011 at 8:47 PM

Although the blog post points out that went Searchtastic went offline July 26, 2011, your description is more accurate :)

Reply

Dimiter Petrov January 14, 2012 at 7:14 AM

Not sure why Twitter has decided to make things harder for it’s users with the new “Activity” tab. All the useful filters are gone. Things like “My Favorite Tweets”, “My tweets retweeted” are now found only in their API. This gives 3rd party applications and websites the opportunity to offer this functionality. An example is this very small and simple website I’ve created – http://TimelineTweets.com It’s just using the API and provides you with the filters mentioned above.

Reply

Dave Larson January 15, 2012 at 8:32 PM

Nice! I’ll let people know about your site. Twitter dropping those has been a big opportunity for sites like Favstar (and yours) to provide that functionality.

Reply

Leave a Comment

{ 29 trackbacks }

Previous post:

Next post: