Out of the Hellmouth - maybe
Thursday, December 20th, 2007Google announce the end of the supplemental index
In a curiously timed announcement, just when many people are turning to thoughts of Xmas rather than SEO, Google have said that from now on all search queries will access the full index for relevant results, effectively ending the problem of good quality pages being ignored because they’ve been relegated to the supplemental index.
Supplementals have been a serious problem for the last few years for many sites which have either a deep navigation structure or insufficient inbound links - both situations that result in pages with a low PageRank; which is known to have been a trigger for dropping out of the main index and into the supplemental one. Because Google was only employing the supplemental index when there were insufficient relevant pages in the main index for a query, any pages with rich content but poor PageRank were effectively being excluded from achieving good search results.
Some commentators have suggested that the supplemental index goes hand in hand with PageRank to enable a fast enough response time to queries - Dan Theis has a blog posting on the subject which makes interesting reading and it’s intruiging to wonder what Google have been doing under the hood if his theory was right and how they’ve overcome the performance problems it suggests.
So far I haven’t seen any evidence of change in search results, but that may be because I’ve been used to designing with a view to avoiding the problem. However I’ll be revisiting a number of sites which I know have suffered in the past to see if matters improve for them.
It has to be said that a number of SEO commentators are sceptical about whether there will be any real benefit or if it’s just window-dressing. Andy Beard is one of those who also isn’t seeing any change in the SERPS. However to be fair there may be a delay in getting any changes rolled out through the vast number of data centres that Google uses. One thing I’ll be watching closely is the listing of internal links in Webmaster Tools, because I’ve long suspected that this only lists pages that come from the main index. If that is true then we should see all the pages in a site appearing in that listing. I’ll keep watching this and return to it in a few weeks time.
Basically you enter an initial search as normal and the usual results list appears in the right half of the screen. On the left (or optionally above if you reposition it from the settings menu) the cloud appears with your initial search terms in bold red in the centre. Around it are clustered some other related terms and if you hover over one of them that word is temporarily added to your base search phrase (you’ll see this happen in the search input box) and the search results update accordingly; as does the cloud. Hover over another word and that one replaces the first addition, while if you click on it the word is added to the search query as a persistent addition so you can then refine further without losing it. Hovering over a word also causes a red x to appear beside it and by clicking the x you can exclude that word in the same way as using a minus sign would in the search box. Double-click in a blank area of the cloud and a text box appears so you can add a word that doesn’t appear in the cloud.



