Press "Enter" to skip to content

Category: Net: Search Engines

Search: Choosing a good Search Engine Optimization Company

Huh, just came across something that slightly cheered me up. I just saw an advertisement (provided by Google Adsense: see top of the page) for a company offering one of the services I do for a job (search engine optimisation and placement). I went to their site to see how good they were (as I hadn’t heard of them before) and…

They’ve got a “Google PR” value of “0”, I can’t find their site on Google search for their company name (never a good sign) and finally some of the techniques they “suggest” are good for a site (such as “dynamic meta tags”) would, most likely, get your site banned from the search engine. A good SEO (search engine optimizer) will optimise a site in such a way that it’ll work as a “static site” OR dynamically driven (ok, some “hacks” may be needed to avoid query strings). I also checked their “recommend client” site: no optimisation (bar the “now-redundant” meta tags) and site can’t easily be found in Google!

Therefore, I’d like to suggest the following to anyone considering employing a search engine optimization company: First of all, can you easily find them in the search engines for a) their company name and b) one of their keyphrases (sometimes this is harder to figure out as it may not be easy to see what they are targeting).

Secondly: Do your research. If they suggest creating hidden pages/links, cloaking/fast redirects, duplicate pages (or anything else on Google’s “Do not do” list), then steer clear of them as the site could easily be reported for spam

Search: New Microsoft Search

At the start of April, a Reuters news article came out which quoted Bob Visse, director of Marketing for MSN: We do view Google more and more as a competitor. We believe that we can provide consumers with a better product and a better user experience. Sounds ominous doesn’t it? Many people expected Microsoft to therefore create their own search engine (instead of just using Looksmart, Inktomi and Direct Hit), but it seems things have happened a bit quicker than expected! Yep, a few people have noticed a new robot or crawler indexing the internet and all signs point back to Microsoft at the moment. Whilst it hasn’t yet hit my blog, I have been hit by it on one of my other sites with the following details: – – [20/Apr/2003:12:54:56 +0100] “GET /robots.txt HTTP/1.1” 200 763 “-” “MicrosoftPrototypeCrawler (please report obnoxious behaviour to” The IP address falls within the (in otherwords a netblock which is allocated to a certain Microsoft Corp of One Microsoft Way, Redmond, Washington, 98052, USA. Using that information, I was then able to look at the logs again and saw quite a few page requests (I stopped counting after the…

Search: Changes, Talks and Flames

[Robozilla and the ODP]Warning: extremely long post (2,838) words!

Well, a lot has been happening in the “World of the Open Directory Project” (a.k.a. DMoz) in the last couple of weeks.

First of all, because of server load issues the internal editor forums have been moved to a new server (yippee!) that authenticate with the main server to ensure only valid users can log in. Good idea, but it’s had a few teething troubles (boo!).

Secondly, to help reduce the load on the main part of the ODP, editors have been given a “special” port number on which to connect to edit (hopefully reducing some of the overloading issues on the Apache webserver) – all good. Except if you are behind a corporate firewall and they block that port number 🙁

Thirdly, the “mirror server” at (which is hosted by a fellow editor in Zurich, Switzerland) seems to have “taken off” a bit and is being used by a larger number of people now (mainly as it’s a lot faster) – it’s transferring around 19Gb of data a month.

Fourthly, the ODP staff members have managed to produce “a” copy of the RDF dump. The RDF dump is, in fact, a big big big file which contains the URLs, titles and descriptions of all the (nearly) 4million sites listed in the ODP. Due to a large number of technical issues, this dump hasn’t been correctly produced since September last year. The RDF dump is usually downloaded by organisations such as ‘Google’ to produces localised copies of the ODP (for instance the “PR enhanced” listings at the Google Directory). ODP staff have (this week in fact) managed to produce an RDF dump which is available via there’s only a slight problem. It doesn’t contain “catid”s (unique category identifier numbers) – this is because these numbers got “clobbered” during the technical problems and so ODP staff are having to manually correct these database problems. Hopefully they’ll be fixed soon – but at least the ODP search has now been updated (since that uses the RDF dump) and there is an RDF dump for others to download and play with (which I’m intending to do this weekend).

Search: Do The Google Dance

[Google Dancer]Kuro5hin has an interesting article about what the “Google Dance” is and how it affects your ranking on the worlds most popular search engine.

Long story short: Dance equals Data. Servers. Moving. New Results.

A more complete answer is that the “Google Dance” is the nickname that has been given to the time of the month (usually around the 28th) that the data that “GoogleBot” (Google‘s little spider/robot that goes round ‘reading’ the web) is introduced into the system. However, since Google has over 10,000 servers it does take some time for the data to propagate around (“propagate” has now become my favourite and most used word for some reason). It has been long known that the start of the “Dance” can be found be watching when the data on the www2 and www3 starts ‘reading differently’ than that on the main Google server (an illustration in the Kuro5hin article is to do a query for links to Yahoo!).

Search: Meetup Arrangements Progressing

As hinted to in a previous entry the arrangements for the 2003 Open Directory Project UK editors real life meetup (phew – what a mouthful!) are progressing. We’ve already got a likely date (that I suggested 🙂 ) and voting has already started on the likely locations – Cambridge, Oxford, Leeds and Bournemouth are the most likely – Bradford, Gloucester, Exeter and Leicester are next. But it looks like no one wants to be sent to Coventry – it’s only got one vote so far.. I’ve invited the other 6 editors of Regional/Europe/United_Kingdom/England/Leicestershire/ (and, yes, I have memorised that nice long URL – hence why I keep on quoting it on places such as Resource-Zone) to the internal forum thread discussing it – bringing the total of editors contacted regarding it to over 100. The attendance last year was reasonable at 13 editors (location was the Briar Rose pub in Birmingham), but hopefully we’ll have a few more come this year. If you are an UK ODP editor reading this (I know at least 3 people have found this blog via my private ODP editor profile – the private ones are accessible to ‘editors only’ and only contain a few…