Category Archives: Twitter

Tweets from the past

Embarrassed by some of your first tweets from 2007? Wish you hadn’t got involved in that drunken virtual brawl on Twitter last Christmas? There was a time when you could safely assume that those ramblings would be lost in the mists of Twitter’s archive never to be seen again. A search on Twitter would only give the last few days worth of postings and Google no longer archives the whole of Twitter. True, the Library of Congress does keep copies of every single tweet for posterity but access is only allowed for serious research purposes. So far, the Library has received  about  400 inquiries but has not yet been able to provide access ( So you can breathe easily again? Unfortunately not.

There are commercial organisations such as Datasift ( and Gnip ( that charge an arm and a leg for analysing tweets and other social media comments, but the cost puts their services out of the reach of the casual searcher. You may find, though, that your forthright hashtagged tweets at a conference have been recorded for all to see free of charge (Sharing (or Over-Sharing?) at #ILI2012, And Twitter, itself, is finally providing access to historical tweets.

You can now download your entire collection. Go to your Twitter home page, click on the cog wheel in the upper right hand corner and select settings.

Twitter Settings

At the bottom of the Settings page is a link to request your archive.

Request your archive

You should receive an email a few minutes later with a download link. The file is zipped and once you have unpacked it you can browse your tweets by year and month or search the archive using keywords or hashtags.

Downloaded Twitter Archive
Browse downloaded Twitter archive by year and month
Search downloaded Twitter archive
Search downloaded Twitter archive

I have not been able to work out how often you are allowed to download your archive and, rather annoyingly, there is no top-up option.

Twitter also runs searches on its entire archive – sort of. There is no obvious date option at the moment, not even under advanced search, so it is appears to be all or nothing, and it does not give you everything straightaway. I thought I would have a look at the tweets on Internet Librarian International 2009, hashtag #ili2009, and was surprised that there seemed to be so few. I scrolled down to the bottom of the results and saw “You’ve reached the end of the Top Tweets for #ili2009” with a link to “View all tweets”. Twitter then loaded the remaining tweets as I continued to scroll down the page. About Top Tweets Twitter says:

“We’ve built an algorithm that finds the Tweets that have caught the attention of other users. Top Tweets will refresh automatically and are surfaced for popularly-retweeted subjects based on this algorithm. We do not hand-select Top Tweets.”

There are also links at the top of the results page that enable you to view Top, All, and tweets from just ‘People you follow’.

Twitter Archive search

There are in fact advanced search commands that can be used to include a date range in your search (see for details). Changing my search to #ili2009 since:2009-10-01 until:2009-10-31 did seem to work. I am not convinced, though, that Twitter is giving me everything, even when I choose ‘All’. It’s a start and long overdue, but I’m not going to abandon my own archiving strategies just yet.

Tweets from #saoim – Southern African Online Information Meeting

I had a fantastic week at SAOUG’s 11th Southern African Online Information Meeting (#saoim) this week. I gave a workshop and a keynote conference paper (details to follow in a separate post) but did not tweet as much as I usually do mainly because I was so busy talking to people and making new friends. The conference programme was excellent and I picked up many new ideas that I’m going to work on over the next few months. SAOUG (Southern African Online User Group) who had organised the meeting had also set up a group of social media reporters whose responsibilities were to tweet and blog the event. They did a great job and on one of the main conference days #saoim was trending on Twitter in South Africa!

If you are quick you can see some of the #saoim tweets by searching or For a more permanent record I have created PDF Tweetdocs for each of the days of the conference and for the pre and post conference workshops. Tweetdoc ( imposes a limit of 500 tweets per document so for two of the days there may be some tweets missing. The documents are as follows:

4th June 2012

5th June 2012

6th June 2012

7th June 2012

8th June 2012

9th June 2012

Presentation: Search Turns Social – Resistance is Futile

The presentation I gave to CILIP in Hants & Wight yesterday (Search Turns Social – Resistance is Futile) is now available on authorSTREAM at

It is also available on Slideshare at and temporarily on my web site at

A good year for culling Google search options

2011 is proving to be a vintage year for disposing of Google search options. Google, in common with most search engines and database providers, is quick to announce wonderful new search features but tardy in telling users about discontinued tools. In fact, it generally takes several messages to the Google support forums about something not working in order to elicit the news that a service has been withdrawn.

UK Google Maps property search was one of the first to go this year. Google had done deals with several UK online estate agents so that when you ran a search in Google Maps on your post code together with the word property you were presented with a Google map showing all the properties for sale or rent in your area. You could even specify price range, the number of bedrooms and bathrooms.

Google Maps Property Search

The service was discontinued in February of this year with “low usage” being given as one of the reasons. That’s hardly surprising because after the launch Google did almost nothing to promote it and did not even offer a hint on the UK Maps home page that it existed.

Next to go was starred results. This enabled you to star or bookmark pages in your results list so that next time you ran a similar search they would appear separately at the top of your results.

Google starred results

The ability to create new starred results was removed but your existing starred results remain and will continue to appear in search results (No More Starred Results in Google Search

The ‘define:’ command was the next to be axed although the same functionality is still available under the Dictionary link in the left hand menu on the results page. Instead of simply prefixing your term or abbreviation with define: you now have to run a search on it and then click on Dictionary. The results are the same but it requires a couple of additional clicks to get there.

Next up were the numerous changes to the appearance and layout of the results page in the runup to the launch of Google+. One casualty was the ‘Similar’ link that used to appear next to most entries in the results page. This would find pages similar in content and from similar types of organisations to your selected page. Although it has gone from the results the related: command is still available and it remains on the Advanced Search screen. Another victim of the revamp was the Wonderwheel. This was a great way of exploring concepts and alternative search terms within a search, especially if you are working in a subject area new to you.

Google Wonderwheel

The closest alternative is the Related Searches option in the menu on the left hand side of the results screen. It doesn’t allow for the same ease of navigation between searches and doesn’t match the variety of terms and phrases that the Wonderwheel offered.

Related searches

The latest disappearance is Realtime search, which returned mostly Twitter results. The contract giving Google direct access to Twitter expired on July 1st and Google have not renewed the contract. This started out as a very useful Twitter search tool as Twitter’s own search at returns results from the last few days and many of the advanced search commands do not work. More recently, though, Google Realtime became unreliable and started returning increasingly bizarre results, usually with hashtags because it would automatically correct what it thought was a spelling mistake. You can still use Google to search Twitter by combining your search terms with but it does not pick up everything. Bing Social is a little better and is generally good but neither pick up everything.

As an example, I recently attended and spoke at the South West and Mid Wales Library Partnership staff conference. The hashtag was #swamp11 and two days after the event the archive document I created in Tweetdoc ( listed 185 tweets, which tallied with the number in my own record. Bing Social finds 75 tweets, Topsy tracks down a mere 38 and when you force Google to do an exact match search together with you get a paltry 4 results.

And finally…. a search option that many researchers find invaluable seemed to have vanished over the weekend. A link to the Advanced Search screen had vanished from the Google home page, as had Language Tools. Both are now hidden under the gear icon in the upper right hand corner of the screen.

Advanced Search Link

What will go next? Who knows except Google and they always seem reluctant to tell us. As Gary Price said in his article on the Search Engine Land site (

“..taking a service offline is up to the company. Users are free to go elsewhere or share their opinions with Google. What we hope for is simply for the company to let users know what’s going on versus waiting around, speculating, and wasting time.”

Tweetdeck sneakily forcing users to use

This morning I updated Tweetdeck and one of the new features is the incorporation of a service called This allows you to tweet more than 140 characters. Type in your tweet in Tweetdeck and as soon as you go over the limit of 140 the background in your tweet box turns yellow (this may vary depending on whether or not you have customised your colours). Next to the Send button you’ll also see a new button “Long update using”. Tweetdeck users will see the full text of the extended tweet but others will have to click on a link. A debate has already started around this new option and I am not going to repeat the arguments here. I am more concerned about what has happened to auto URL shortening.

After the update I wrote a tweet and then added a URL that took my tweet over the 140 character limit. The background turned yellow and I waited for the URL to be shortened. It wasn’t. I had to click on the link to shorten it. I mentioned this on Twitter and, at the time of writing, no-one else seems to be having the same problem. So I decided to run some test tweets and this is what I am seeing.

1. Tweet including URL within 140 character limit

The URL is automatically shortened

Tweetdeck URL shortening

2. Tweet including URL over 140 characters

The URL is not shortened and there is the new option to send via

Tweetdeck URL not shortening

Auto URL Shortening is turned ON but nothing happens. I sit and wait and nothing happens. I turn URL shortening off and then back on again – still nothing happens. I have to click on the link to shorten it:

Tweetdeck URL in long tweet finally shortened

I hope that this a bug and not some attempt by Tweetdeck to force us to use I have experimented several times over the last couple of hours with different tweets and see the same results every time. No-one else in my network seems to be having the same problem, though, which is making me feel a little paranoid. If you have updated to the latest version of Tweetdeck I’d be interested to hear whether or not your experiences are the same as mine.

Further background information: I ran these tests using  Tweetdeck version 0.37.2 under Windows 7 professional (updated with multiple updates earlier this morning) on an HP laptop. useful Twitter summary or major irritation? ( organizes links and tweets into a newspaper-style format. Newspapers can be created for your own Twitter network, a list or #tag. It is run by SmallRivers, a privately held Swiss startup co-founded by Edouard Lambelet and Iskander Pols and located at the Swiss Federal Institute of Technology EPFL campus.

To create a newspaper simply sign up with your Twitter account and decide whether you want a newspaper generated from your own Twitter network, a hashtag or a Twitter list. then extracts all tweets that include URLs, the content found at these URLs (text, blog post, photo, video), analyses the content to identify the topic (for example Politics, Technology ) and then constructs a newspaper for you.

The front page gives you what thinks are the most important stories for each topic. How it chooses those is not clear: the FAQ merely says that it uses semantic analysis and “ magic”! You can view more stories on a topic by clicking on one of the tabs at the top of the page.

Example of an edition of Karen Blakeman's

The paper is updated daily but you can change the update frequency to morning and evening or weekly editions and also alter the time at which the edition is created. Email alerts can be set up to tell you when a new edition is available.

I was initially sceptical about the value of I use Tweetdeck to manage my Twitterstream with searches, lists and groups to help me keep up with subjects and people that are important to me. I also have RSS feeds of some of my searches. After a few days of using it, though, I found that it did bring to the fore important or interesting stories that I might otherwise have missed, especially when I am travelling and do not have time to catch up with all of my Twitterstream. It has also highlighted Twitter users – mostly publishers- who I follow but who rarely report on anything that is relevant to my areas of interest. (A frenzy of unfollowing ensued after I viewed my first few editions). I can also see it as being a useful way of presenting Tweets and information from a conference. Simply set up a for the hashtag. It is by no means perfect and I would not rely on it as the sole means of keeping up to date. It does miss and exclude stories that are important to me, but the paper that is produced is easy and quick to scan and as long as you are aware of its limitations it can be a useful addition to your information management toolbox.

So why the possible “major irritation”? You can promote a paper automatically on Twitter using the “Promote it” option. The default is set to ON – or certainly was when I signed up – with the result that some of us were being bombarded with notifications that someone’s latest was out. Frankly, I don’t care and neither do a lot of other people. It created a backlash against the service for a while so if you do decide to set your own daily paper please go into your settings and set ‘Promote on Twitter’ to OFF. If you have set up a conference or hashtag, simply mention the link on an appropriate blog or web page, or in the occasional tweet. People can them decide for themselves whether or not to subscribe to it.

If you want to keep up with developments at they have a blog at, are on Twitter at @SmallRivers and Facebook at

Update: Just tried to change the update frequency and title for two hashtag newspapers. You can’t! The settings can only be changed for a newspaper generated for your Twitter username. #FAIL

iPhone 4 to be recalled: it’s true – the Daily Mail says so

The Daily Mail has done it again and proved that the quality of their research is second to none, because they don’t do any. They have an exclusive on the possible product recall of the iPhone 4. You can see the article on the Daily Mail site at, or possibly not. By the time you read this posting the Daily Mail might have realised that they have made complete idiots of themselves and removed the story. So here is a screen shot of the headline:

Daily Mail get it wrong again

The source of the story? The man himself: Apple CEO Steve Jobs announced the possible recall last night via his Twitter account @ceoSteveJobs. There’s just one teensy weensy problem. The ‘bio’ for @ceoSteveJobs clearly states:

“I don’t care what you think of me. You care what I think of you. Of course this is a parody account.”

Perhaps the Daily Mail does not understand what parody is? Or maybe the ability to read is no longer a requirement for Daily Mail journalists?

Checking the authority and veracity of a source is an important part of research as those of us who do this for a living well know. It can be a time consuming and long-winded process but in this case it was clearly stated on the Twitter account that the source was A PARODY ACCOUNT. How difficult is it to read the profile on this account?

Steve Jobe Twiiter Parody Account

No doubt the Daily Mail will now regale us with tales of how Twitter is riddled with liars, fakes and false information and that it should be immediately banned from these shores.

Time to sing along to that popular ditty “The Daily Mail Song” by Dan and Dan

And as I finish writing this I see that the Daily Mail have pulled the story from their web site. If you are desperate to see a copy of the original I have one here. It will feature in my workshops on assessing the quality of information!

TwInbox – Use Twitter from Outlook

This free plug in enables you to view and manage your Twitterstream from within Outlook.

Technical requirements are Microsoft Windows 2000, XP, Windows Vista or Windows 7 with the latest Service Pack. Outlook 2003 SP3, 2007 SP2, 2010 (32-bit and 64-bit.). Note that TwInbox does NOT work with Outlook Express.

According to the web page, features include:

  • Update your Twitter status directly from Outlook.
  • Receive your Twitterstream updates in Outlook.
  • Archive, manage, group and search your tweets in the same way you manage your email
  • Search and track keywords
  • Group tweets by sender, topic, etc using the Search feature
  • Manage multiple Twitter accounts
  • Assign custom folder and categories to new messages
  • Use Outlook’s “Reply” and “ReplyAll” commands to send twitter direct messages and @replies
  • Automatically sort new tweets into folders
  • Shorten URLs with
  • See graphs of your Twitter usage statistics

I am still experimenting so can’t yet comment on how easy the above are to set up. I shall probably continue to use Tweetdeck as my main application for managing my Twitter accounts on a day to day basis. TwInbox, though, seems to be a quick and easy way of archiving tweets that contain information I may want to refer to at a later date.

UK’s Tweeting Councillors

Heavy snow hit us overnight in Caversham and as I write the fluffy white stuff is still falling. From my office window I can see through a gap in the houses opposite the traffic on Briants Avenue and there have been no buses, or indeed any traffic at all. Our local radio stations provide good general information and updates on the weather, roads and public services but #rdg in Twitter is by far the best source of detailed local news. So today I was paying extra attention to the #rdg column in my Tweetdeck and spotted that one of Reading Borough’s councillors, @CllrDaisyBenson, is on Twitter. A couple of tweets later she informed me that three of her Lib Dem colleagues are on Twitter and about the same time I found the CllrTweeps web site – Finding and following the UK’s Tweeting councillors at

The list was started by @CllrTweeps who is @JamesCousins. The project is currently being developed by James Cousins and @DafyddBach. Not surprisingly the wonderful @Liz_Azyan has been involved with the list and is credited with identifying a lot of the councillors.

You can search the list by council, party and “tweeps” – an alphabetical list of tweeting councillors.If you are a tweeting UK councillor and not on the list details of how to add your user name are at

UK Tweeting Councillors

Which country makes the best chocolate

Major headline news in UK is the hostile bid by Kraft for chocolate manufacturer Cadbury. Cadbury apparently called Kraft’s offer derisory but there are now stories circulating that Hershey is in the race to gain control of Dairy Milk and Bourneville chocolate, amongst others. This has started a debate over US vs UK chocolate (see BBC News -The great transatlantic chocolate divide This then spread over to  Twitter and other countries were mentioned as producers of the world’s best chocolate.

So choccy consumers of the world, here is a twtpoll to determine the truth! Poll ends Friday 18th December 2009.