Well, the proverbial has hit the fan with Google search getting really personal (Official Google Blog: Search, plus Your World http://googleblog.blogspot.com/2012/01/search-plus-your-world.html). Good news or bad news? A bit of both. It’s great for tracking down information or a comment made by someone within your personal social networks but a disaster if you are conducting serious, global research. And Google has made so many other changes: dumping the ‘+’ symbol as a way to enforce an exact match search and no longer ‘ANDing’ terms are just two. The results are here, there and everywhere but not necessarily where you want them. Changing your default search engine is one solution but there are times when Google’s extensive coverage is required. There are ways of switching off Google’s improvements and options that you can use to improve results.
I am running a workshop for UKeiG on how to make Google behave - at least some of the time! – in Birmingham on February 8th. The areas we’ll be covering will include:
- how Google works – what Google tells us and what we have to guess
- recent developments and their impact on search results
- how Google customises your results and can you stop it?
- how to use existing and new features to focus your search and control Google
- how and when to use Google’s specialist tools and databases
- what Google is good at and when you should consider alternatives
There will be time to experiment and try out the techniques for yourself. Exercises will be provided to help you test out the search features but you are free to explore and try out searches of your own.
If you are interested further details and a booking form are available on the UKeiG web site at http://www.ukeig.org.uk/trainingevent/how-make-google-behave-techniques-better-results-karen-blakeman
Tags: Google, googlebrum, training, UKeiG, workshop
I travel a lot for both business and leisure and I use public transport whenever possible. The plus side to this is that if it is a longish journey – for example Reading to Manchester – I can settle down on the train and get on with some work. The down side is that I have to know my way around the transport networks, not just in the UK but also in the other countries I visit. After over 20 years of business travel I have a range of tools and timetables bookmarked on my laptop plus the really useful stuff inside my head gained from experience. For example, the easiest route is not always the quickest: a single cross country stopping train may take longer but the seemingly quicker alternative of three changes can be seriously stress inducing and take longer if there are delays, signals failures, “incidents” and you miss your connections. I recently spotted that two of my clients link to Google Transit (http://www.google.com/transit) on their map and directions pages so I thought I would give it a go. You do not have to go to the Google Transit page to start using this; if you are already on Google Maps and are looking for directions from A to B, choose the middle “By public transport” icon. So let’s try a journey from Reading railway station to Milton Keynes.
Well I didn’t expect that: a 3 hour journey using 3 buses. Running the journey through the Google Transit page itself the journey time increases to around 3.5 hours and the number of buses to 4.
Google is well known for giving different results for the same type of search depending on the route you take but I was perplexed by Google’s insistence that I have to travel by bus. OK, it’s Saturday so there are probably engineering works and buses are probably the best option. I checked the National Rail web site (http://www.nationalrail.co.uk/):
No problem it seems. My train journey via London would take just under 2 hours. Perhaps bus transport is Google’s default option? Underneath the ‘B’ location is ‘Add Destination – Show options’. Click on this and from the ‘Prefer’ box you can choose Any mode of public transport, Bus, Underground, Train, Tram/Light rail. The box underneath offers Best route (no definition as to what ‘best’ means), Fewer transfers, Less walking. No matter what combination of options I selected Google insisted that bus is the only option.
Perhaps Google is confused by the cross-London element of my journey even though Underground is one of the ‘Prefer’ options. Let’s look at a simpler journey: Reading to Crowthorne. I frequently travel along this route and it is a straightforward journey by rail taking 14 minutes as confirmed by National rail.
Google, however, insists that it requires two buses and 1.5-2 hours!
I tried other routes and it seems that Google, in the UK at least, thinks that public transport means bus despite the ‘Prefer’ options it offers. This could be useful, though, if there is a rail strike and you need to identify alternative means of transport. Or you could go straight to Traveline (http://traveline.info/).
Tags: Google, Google Maps, Google Transit, National Rail, public transport, Traveline, UK
Google has started showing UK postcode area boundaries but not in Google maps as one would expect. Using the standard Google search box type in your postcode and at the top of your results Google shows you a map with the boundaries of the postcode area.
Although the boundaries are in roughly the right area, they are not accurate. In this example, the coverage of RG4 5BE extends north and south to the top and bottom of Star Road. Others have reported similar discrepancies in their areas. As a general indication of the location of a postcode area it is fine but do not rely on Google to identify which streets or parts of streets are covered by it. Google also gives information on the nearest bus stop, which in this case is correct but not the only option. If you click through to the full sized Google map the boundaries disappear and they do not appear at all if you do the search straight away within Google Maps. You do, though, see more information on the public transport options.
Alternative bus stops are given and the numbered routes listed. I was rather puzzled by the number 74 and 74 A, which have never seen, but a quick check revealed that it is the “football” bus that runs once a day and only when there is a match at the Madjeski Stadium. The scheduled times for the next buses are as accurate as the bus company timetables provided via Traveline and Transportdirect. I watched three buses arrive and compared it to Google’s schedule: the number 800 was 7 minutes late, the first number 23 was 6 minutes late and the second on time so Google is not using real time data.
Overall, it’s not bad. Just remember that the postcode boundaries are approximate so if you need something more precise use the Royal Mail web site. The bus timetable will not tell you if a bus is delayed or cancelled but if you are contemplating moving to the area it is a quick way of assessing how good (or bad) the local public transport is.
Tags: buses, Google, Google UK, postcode, public transport, UK
The Ukrainian official companies register can be found at http://irc.gov.ua/ua/Poshuk-v-YeDR.html. The interface and information is in Ukrainian only but Google’s translation option does a good enough job to help you through the site. If you use Google Chrome as your browser you can enable its automatic translation prompt by going to Options, Under the Bonnet, and ticking the Translate box. Many thanks to Ladymyr Bondar for alerting me to the site.
Tags: Business Information, company registers, company registry, official company information, ukraine
The slides for my workshop “Searching without Google”, 28th November 2011, are available at:
http://www.rba.co.uk/as/ – please note that this is a temporary location for the presentation and it will be removed after 2-3 months. Archive copies will remain on authorSTREAM and Slideshare
There is also an addendum to the presentation that summarises some of the questions and answers covered throughout the day together with “top tips” and sites that the participants themselves suggested. This is also available at http://www.rba.co.uk/as/.
The text of the addendum is reproduced below.
Tools for creating your own search engine
Several people said they will investigate setting up a custom search engine for their preferred sources and frequently used web sites. Google’s custom search engine is at http://www.google.com/cse/ and Blekko.com lets you set up ‘slashtags’ to create lists of sites for searching. One person said that they are going to try both and compare ease of use and results.
What can one do when the link to the Google’s advanced search screen disappears altogether?
The link to Google’s advanced search screen has been moved to the drop down menu underneath the cogwheel in the upper right hand corner of your screen, but several reported that it had even vanished from there for a couple of days last week. Next time you use the screen bookmark its URL so that you can go directly to it (of course Google can always change that!). Also learn the advanced search commands e.g. filetype: site: etc. so that you can type them into the standard search box.
There is a list of commands at http://www.rba.co.uk/search/SelectedGoogleCommands.shtml (also a PDF version)
(The GoogleGuide list of commands at http://www.googleguide.com/advanced_operators_reference.html was last updated in 2008 and contains commands no longer in use)
Tools for monitoring social media and alerting you when a subject is mentioned
Although Google and Bing both include social media in their search results it is often better to use a tool designed specifically for the job. All three of the following offer RSS alerts for searches.
Topsy.com – searches tweets, videos and photos on Twitter, and now Google+
SocialMention.com (can be slow at times) – blogs, Twitter, bookmarks, video, audio
Icerocket.com – blogs, twitter, Facebook, images
Are there still some directories alive and updated e.g. DMOZ? Or is the war of directories vs search engines over?
The Yahoo directory is still online although it is not easy to find and it has not been updated for several years. Similarly, some sections of DMOZ appear not to have been updated for at least a year and the entries under some headings look like advertising. The day of the mega-directory may be over but specialist and subject specific listings are still being developed. They do, though, require considerable time and effort to maintain and inevitably some are forced to close because of a lack of funding e.g. Intute.
Are there good tools for events search by subject, region, date?
The events databases that some of us accessed via services such as DataStar have long gone so it is not possible for example to search for events on nanotechnology taking place next year between June and September in Europe. Possible alternative search strategies include:
- identifying major events venues and their calendars
- locating relevant trade and industry newsletters, portals, magazines that may list events in their sectors
- relevant trade and professional bodies and associations
Are there tools that search the live web rather than using indexes of cached pages?
Biznar.com, Mednar.com and some social media search tools search the “live” web but they are limited to searching a small number of sites and are slower than Google and Bing in returning results. There are no free public search tools that search the entire web live – it would take far too long – and by the time the search engine would have finished the information would be out of date!
Searching for scientific publications that are not published in major English language journals
Google and Google Scholar are still a good starting point for this type of search, but it was suggested by several of the workshop participants that Open Access journals could also be investigated as well as national digitised collections and subject specific listing and portals.
Searching news in other languages (alternatives to Google News)
Country versions of Google News give priority to local content but you can identify news sources in individual countries at the Newspaper & News Media Guide http://www.abyznewslinks.com/. You cannot search the publications from this site but it will tell you what is available and the language of publication.
What will be the trend of the next 5 years? More competition? More takeovers of the smaller search engines? More specialist tools?
All of that! Many smaller specialist search tools continually emerge and many of them quickly disappear or are bought up by the competition. It is impossible to predict exactly what will happen, or even if Google will remain the dominant search tool on the web. If Google’s popularity starts to wane it probably will not be because a “Google-killer” arrives on the scene but because Google goes too far in trying to take control and automatically “improve” results for users. Many of us feel that it is already going in that direction.
Top tips and tools to try back at work
- Custom Search Engines – use Google CSE (http://www.google.com/cse/) or set up a ‘slashtag’ on Blekko.com so that you can quickly and easily search those sites you regularly use. Note: they will not include password protected sites or sites where you need to conduct a database search
- Biznar.com – real time federated search of selected key business resources
- Chemspider.com – brings together chemical information from a wide range of resources. Maintained by the Royal Society of Chemistry
- Investigate image search sites other than Google. (Multicolr http://labs.ideeinc.com/multicolr/ was specifically mentioned
- Paper.li – gather together tweets and/or Google+ posts containing links based on keywords or from a user and their twitterstream. Results are presented in an easy to read newspaper style.
- http://www.zanran.com/ – searches for data and statistics contained in graphs, charts and tables
- http://duckduckgo.com/ – alternative search engine that does not customise or personalise your web results
- http://integrals.wolfram.com/ – Wolfram Mathematica online integrator. Ideal for maths homework.
- http://www.coremine.com/ – Norwegian initiative providing an interesting visual interface to the biomedical literature
- Central Index of Digitized Imprints (zvdd) http://www.zvdd.de/ Access to and search options for German digitized works from the 15th Century to the present. Collections are listed at http://www.zvdd.de/dms/browsen/. See also http://www.europeana.eu/portal/ “to explore the digital resources of Europe’s museums, libraries, archives and audio-visual collections”
Tags: Online Information 2011, online11, Search Strategies, search tools, seminar, workshop
A reminder that Yahoo Site Explorer is closing down tomorrow (November 21st ) and I assume that the link and linkdomain commands will go with it, although they are not specifically mentioned (http://www.ysearchblog.com/2011/11/18/site-explorer-reminder/). Webmasters are being told to use Bing Webmaster Tools. This enables you to analyse links to your own domains but is no use if you want to find who links to other web sites as part of research. Bing, or Live.com as it then was, removed its link and linkdomain commands in November/December 2007 and Yahoo was left as the only reliable alternative. The link command enabled you to find who linked to a specific page on the web and linkdomain found links to anywhere on a specified web site. Both were useful ways of finding other sites containing similar content and discovering what others were saying about a page. Google’s link command is useless as it picks up a minuscule number of results, which now leaves Blekko (http://blekko.com/) as the only realistic alternative.
Blekko enables you to track down linked pages in two ways but both lead to the same results. The first is to use their slashtags ‘/links’ and ‘/domainlinks’ with a URL or domain name. For example http://www.rba.co.uk/sources/registers.htm /links will find pages that link to my official company registers page whereas http://www.rba.co.uk/ /domainlinks finds all inbound links to my site rba.co.uk.
The second route is via your search results. Below each entry is a downwards pointing arrow. Click on this and select ‘links’ from the pop-up box.
You will then see a list of sites that link to that page.
To view inbound links to the whole of the web site click on the seo option below the result and you will see some statistics together with the total number of inbound links.
Click on the inbound links number and Blekko presents you with a list of domains containing links to yours and how many.
To see exactly where the links are located and where they go to on your site just click on the number in the links column.
I have only looked in detail at a couple of sites but Blekko seems to do a good job and is certainly far superior to Google. The Blekko data on my own site seems to correspond with that available from Bing Webmaster Tools but of course I cannot compare other sites in the same way. My initial thoughts are that for link searching Blekko is definitely worth adding to your research toolkit.
Tags: Blekko, link, linkdomain, Search Engines, Search Strategies
- making automatic spelling corrections
- personalizing your search by using information such as sites you’ve visited before
- including synonyms of your search terms (matching “car” when you search [automotive])
- finding results that match similar terms to those in your query (finding results related to “floral delivery” when you search [flower shops])
- searching for words with the same stem like “running” when you’ve typed [run]
- making some of your terms optional, like “circa” in [the scarecrow circa 1963]
Google Verbatim
Tags: Google, Search Engines, Search Strategies, search tools, Verbatim
Company Director Check (http://company-director-check.co.uk/) is a sister database to Company Check (http://companycheck.co.uk/), which I reviewed earlier this year (http://www.rba.co.uk/wordpress/2011/01/10/free-uk-company-information/). It provides free access to information on current and past directors of UK companies that until now has only been available for a fee. Director searches can unearth links between apparently unrelated companies and help you identify “families” or groups of companies. It can also bring to light interesting patterns of behaviour. For example, I carried out a search on a director whose business activities had aroused my suspicions. I knew he had run companies in the past that had been dissolved and his most recent venture had gone into liquidation. Looking at the list of companies of which he had been director it became clear that 6-8 weeks before a company was dissolved or went under he would set up a completely new company. This had happened so often that it was not just me who had begun to smell a rather large rodent. I understand that he is “currently under investigation”!
If you are viewing a company in Company Check click on the director’s name and you are taken straight to their record in Director Check. Alternatively just run a search on the person’s name in Director Check. A list of possible matches will be presented to you, which you can refine by entering a postcode. Alternatively just work through the list until you are certain that you have found the correct person. Do not be surprised if you find a director has multiple IDs. There is nothing “dodgy” about this, it just reflects the way the system has evolved over the years. Companies House have carried out a massive exercise to try and fix this but there are still some multiple IDs in the database.
The information that is provided includes full name, short name, month and year of birth, address and past and present directorships.
The status of each directorship – active, dissolved, resigned – is displayed followed by a summary of each of the companies. More detailed information on the individual companies can be found on the Company Check web site.
Now that so much directorship information is freely available it will be interesting to see if more directors make use of the option to provide a service rather than their home address for the public record.
Definitely one to add to your business research toolkit.
Tags: Company Check, company directors, Director Check, UK
I have been complaining for several months that Google does not always “AND” your search terms and delivers results that do not contain all of your terms, or their synonyms, in the page itself or in links to the page. There was a time when you could force Google to deliver exactly what you wanted by prefixing your terms with a plus sign. That option has now gone and Google says that you have to use double quote marks around your terms and phrases instead. Not only is it tedious to have to surround every term with “…” but it does not always work!
The evidence
I recently took a photograph of autumn leaves on Heron Island in Caversham and uploaded it to Flickr. At the time I hadn’t noticed that there was a bird hiding amongst the leaves and when it was pointed out to me I assumed it was a pigeon of some sort. Someone else, however, thought it might be a parrot. I have not heard of any sitings of parrots in my area but decided to check Google to see if there were any reports. My first search strategy was parrot “Heron island” caversham UK
Over 8,000 results! Unbelevable – which it was. Looking at the top results and their cached copies revealed that Google had decided to forget about parrots or birds of any kind and look for just “heron island” caversham UK.
Changing the search to “parrot” “Heron island” caversham UK reduced the number of results to 84.
This time Google was leaving out Caversham or UK or both. Amending the strategy yet again so that both caversham and UK were within quote marks reduced the number of hits to 23.
There were a handful of directory listings containing all of my terms but the rest contained only one or two of my terms, for example the Tripadvisor page shown below.
There was no obvious logic as to why these irrelevant pages had been chosen by Google – remember that the grand total was a mere 23 – and they were not advertisements. Using advanced search and the allintext option made no difference whatsoever. For the final version of my search Bing found 15 pages that contained all of my terms but sadly nothing to do with parrots in Caversham, UK. DuckDuckGo found three documents but again no siting of a parrot of the feathered variety in my neighbourhood.
I was disappointed that my original identification of the bird seems to have been correct but extremely annoyed with Google. I had to wade through irrelevant documents and wasted time tweaking my search only to find that Google was ignoring my strategy anyway. I could understand it if my search had zero results and Google wanted to give me something, but there were some documents that did have all of my words. Various scripts that automatically add quote marks around your terms have been written since Google withdrew the + sign for general searching. These really aren’t much help because I sometimes want Google to look for variations of some of my terms and Google seems to be ignoring the quotes marks when it feels like it. More reasons to look seriously at the alternative search tools that are out there.
Tags: Google, Search Strategies
Fed up with Google ignoring your search terms and giving you something completely different? Confused by irrelevant tweets and postings in your results? At the recent Internet Librarian International conference in London one of my fellow participants told me that he would not mind Google collecting his search and personal information if it gave him better results but he said that it seems to make them worse. Judging by the comments from some of the other conference goers Google’s attempts at personalisation and semantic search are not always delivering what the searcher needs. There are several steps you can take to try and depersonalise your results but even then Google can still mess up the search. Perhaps it’s time to seek out a different search tool.
Yahoo is now using Bing’s database and search results for web and image search so you might just as well go straight to Microsoft’s Bing (http://www.bing.com/). The trouble is that Bing is starting to behave like Google by messing with your search terms (Bing becomes more like Google and personalises http://www.rba.co.uk/wordpress/2011/10/07/bing-becomes-more-like-google-and-personalises/). So what are the other serious alternatives? DuckDuckGo (http://duckduckgo.com/), also known as DDG, may have a silly name – it certainly put me off from using it for some time – but once you get over that it does have a lot going for it.
It has been around for a while and when it was launched one of its main selling points was that it does not track or share your search and web browsing habits, or try to personalise your results (see https://duckduckgo.com/privacy.html for more information). That’s all very well but how good are the results?
The home page is minimalist as are most search engine’s these days.
As soon as you start typing you’ll notice that there are no suggestions appearing in a drop-down menu below the search box. Some may regard that as a good thing but I do occasionally find them helpful if I am researching an unfamiliar area. In compensation DDG offers “search ideas” on the results page that make up for the absence of suggestions and related search options. The results page is clean and uncluttered with search ideas on the right hand side of the screen. You add one of the “ideas” or terms to your search simply by clicking on it, but you cannot add more than one and the search ideas disappear from subsequent results pages. The only way I can see of adding more than one is to type them into the search box yourself.
When you hover over an entry a “more results” link appears that finds more articles from that site and if you look at the results URL you will see that the site: command is used. There is no link to an advanced search screen but there are an incredible number of what DDG calls “Goodies”. The ones that I have found to be most useful are:
- site: followed by a domain name – searches for your terms within the specified site
- inbody: followed by your search term – looks for your term in the main part of the page
- intitle: followed by your search term – looks for your term in the title of the page
- filetype: followed by a file extension – looks for specified file formats containing your terms
- sort:date to sort by date (uses results from Blekko)
- region: followed by the standard two letter country code e.g. regions:fr to boost pages from France
Then there are the DDG !bang commands (https://duckduckgo.com/bang.html). These automatically take you to other search engines, for example your search terms followed by !images runs an image search on Google and !videos will run a video search on Bing. Details on general syntax, keyboard short cuts and ‘tech goodies’ are at http://duckduckgo.com/goodies.html and http://duckduckgo.com/tech.html. It all looks somewhat daunting but it is worth working your way through them and drawing up your own list of what you think you might use on a regular basis. If you still find it all a bit too much to take in then use the options under the arrow next to the search box at the top of the results page. This brings up a menu of some of the more popular types of searches.
For some searches DDG gives you a red box at the top of the results page containing “zero-click” information extracted from pages and DDG’s Topic Lists for example a possible answer to your question or the result of a conversion/calculation. For a search on Mapledurham watermill it gave me a description and link to Wikipedia along with links to DDG Topics Lists for Grade II* listed buildings in Oxfordshire and museums in Oxfordshire.
My request to convert euros into pounds came up with a calculation generated by Wolfram Alpha.
Would I use DuckDuckGo as my default search tool? Difficult to say at this stage. I do miss Google’s time search option but DDG’s sort:date goes some way to offset that, and I regret to say that there are times when I miss Google’s localisation and personalisation. Looking for pubs or restaurants in Reading and Caversham is so much harder in DuckDuckGo. However, I am getting a feel for the type of searches that work well on DDG and for general web searching it is a good alternative to Google and Bing. It does not play around with your search terms, supports advanced search commands and most important of all it delivers relevant results, some of which are not always in Bing or Google.
Tags: DuckDuckGo, search tools
