Tag Archives: accuracy

Another example of Google’s Knowledge Graph getting it wrong

Voting in the UK election has finished and the results are in, but the dust has most definitely not settled. It looks as we in the UK are in for interesting times ahead. It would help those of us researching the various political parties and policies if Google could at least get the basics right, such as who is now the Member of Parliament for a particular constituency.  I am in Reading East and we have switched from a Conservative MP to Labour (Matt Rodda). Out of curiosity, I tried a search in Google on Reading East constituency.  This is what Google’s Knowledge Graph came up with:

Reading East Google Knowledge Graph

I took this screenshot yesterday (Friday, 9th June)  at around 8 a.m. and expected to see Rob Wilson given as the MP throughout . I was impressed, though, to see that the snippet from Wikipedia correctly gives Matt Rodda as our MP. Whoever had updated that entry was pretty quick off the mark. Possibly a Labour Party worker? The rest of the information, which is taken from Google’s database of “facts”, is either wrong, confusing or nonsensical.

“Member of Parliament: Rob Wilson” – wrong.  But he was MP until around 4 a.m. on the 9th June when the result of the election in Reading East was announced, so perhaps I am expecting a little too much from Google to be that quick about updating its facts.

“Major settlement: Reading” – yes we are part of Reading but I find it strange that it is referred to as a major settlement rather than a town.

“Number of members: 1” – not sure why that is there as each constituency can only have one MP.

“Party: Conservative” – correct for Rob Wilson but the new MP is Labour. 

“European Parliament constituency: South East England” – correct!

The final two lines “Replaced by:” and “Created from:” had me totally flummoxed. The entries are the same  – Reading North, Reading South, Henley.  Reading North and Reading South were constituencies formed by splitting the Reading constituency in 1950. They were then merged back into Reading in 1955, re-created in 1974, and in 1983  Reading East and West were formed (Yes, it’s complicated!). As for Henley, it is not even in the same county.  I can only think that this comes from Caversham (now part of Reading East) being part of Oxfordshire until 1911, when it probably did fall within the Henley constituency.   The “Replaced by” is wrong because Reading East has not been replaced by anything. Google can’t even blame a template that has to be filled in with information at all costs because different information appears in the Knowledge Graph depending on the constituency.

Here is the information for Aylesbury:

And the one for Guildford:

Going  back to the how up to date the information is,  how quickly does Google update their “facts”. Rob Wilson was still our MP mid Friday afternoon. I submitted feedback using the link that Google provides at the bottom of each Knowledge Graph but this morning (10th June) nothing had changed. I’ll update this posting when it does change.

I would hope that most people would look at the other links in the search results, in this case the latest news, but preferably a reliable  authoritative source.  The list of MPs on the UK Parliament website would be an obvious choice but might take a day to be updated after an election. Just don’t rely on Google to get it right.

Searching for the height of Ben Nevis – how hard can it be?

If you have attended one of my recent search workshops, or glanced through the slides, you will have noticed that I have a new test query: the height of Ben Nevis. It didn’t start out as a test search but as a genuine query from me.  A straightforward search, I thought, even for Google.

I typed in the query ‘height of ben nevis’ and across the top of the screen Google emblazoned the answer: 1345 metres.  That sort of rang a bell and sounded about right, but as with many of Google’s Quick Answers there was no source and I do like to double or even triple check anything that Google comes up with.

Ben_Nevis_1

To the right of the screen was a Google Knowledge Graph with an extract from Wikipedia telling me that Ben Nevis stands at not 1345 but 1346 metres above sea level. Additional information below that says the mountain has an elevation of 1345 metres and a prominence of 1344 metres (no sources given). I know have three different heights – and what is ‘prominence’?

Ben-Nevis-3

After a little more research I discovered that prominence is not the same as elevation, but I shall leave  you to investigate that for yourselves if you are interested. The main issue for me was that Google was giving me at least three slightly different answers for the height of Ben Nevis, so it was time to read some of the results in full.

Before I got around to clicking on the first of the two articles at the top of the results, alarm bells started ringing.  One of the metres to feet conversions in the snippets did not look right.

Height of Ben Nevis search results 3

So I ran my own conversions for both sets of metres to feet and in the other direction (feet to metres):

1344m = 4409.499ft, rounded down to 4409ft

4406ft = 1342.949m, rounded up to 1343m

1346m = 4416.01ft, rounded down to 4416ft

4414ft = 1345.387m, rounded down to 1345m

As if finding three different heights was not bad enough, it seems that the contributors to the top two articles are incapable of carry out simple ft/m conversions, but I suspect that  a rounding up and rounding down of the figures before the calculations were carried out is the cause of the discrepancies.

The above results came from a search on Google.co.uk. Google.com gave me similar results but with a Quick Answer in feet, not metres.

Ben-Nevis-4

We still do not have a reliable answer regarding the height of Ben Nevis.

Three articles below the top two results were from BBC News, The Guardian and Ordnance Survey – the most relevant and authoritative for this query –  and were about the height of Ben Nevis having been remeasured earlier this year using GPS. The height on the existing Ordnance Survey maps had been given as 1344m but the more accurate GPS measurements came out at 1344.527m or 4411ft 2in. The original Ordnance Survey article explains that this is only a few centimetres different from the earlier 1949 assessment but it means that the final number has had to be rounded up rather than down. The official height on OS maps has therefore been increased from 1344m to 1345m.  So Google’s Quick Answer at the top of the results page was indeed correct.

Why make a fuss about what are, after all, relatively small variations in the figures? Because there is one official height for the mountain and one of the three figures that Google was giving me (1346m) was neither the current nor the previous height. Looking at the commentary behind the Wikipedia article, which gave 1346m, it seems that the contributors were trying to reconcile the height in metres with the height in feet but carrying out the conversion using rounded up or rounded down figures. As one of my science teachers taught me long ago, you should always carry forward to the next stage of your calculations as many figures after the decimal point as possible. Only when you get to the end do you round up or down, if it is appropriate to do so. And imagine if your Pub Quiz team lost the local championship because you had correctly answered 1345m  to this question but the MC  had 1346m down as the correct figure? There’d be a riot if not all out war!

That’s what Google gave us. How did Bing fare?

The US and UK versions of Bing gave results that looked very similar to Google’s but  with two different quick answers in feet, and neither gave sources:

Bing UK

Ben-Nevis-Bing-UK

Bing US

Bing-Ben-Nevis-US

I won’t bore you with all of the other search tools that I tried except for Wolfram Alpha. This gave me 1343 meters or 4406 ft. At least the conversion is correct but there is no direct information on where the data has been taken from.

Ben-Nevis-WA

The sources link was of no help whatsoever and referred me to the home pages of the sites and not the Ben Nevis specific data. On some of the sites, when I did find the Ben Nevis pages, the figures were different from those shown by Wolfram Alpha so I have no idea how Wolfram arrived at 1343 meters.

So, the answer to my question “How high is Ben Nevis?” is 1344.527m rounded up on OS maps to 1345m.

And the main lessons from this exercise are:

  1. Never trust the quick answers or knowledge graphs from any of the search engines, especially if no source is given. But you knew that anyway, didn’t you?
  2. If you are seeing even small variations in the figures, and there are calculations or conversions involved, double check them yourself.
  3. Don’t skim read the results and use information highlighted in the snippets – read the full articles and from more than one source.
  4. Make sure that the articles you use are not just copying what others have said.
  5. Try and find the most relevant and authoritative source for your query, and ideally a primary source. In this case it was Ordnance Survey. GB officially taller – Ben Nevis  https://www.ordnancesurvey.co.uk/about/news/2016/gb-officially-taller-ben-nevis.html