There is still room for a good blog search engine
Well I had a good idea for a post today about the problems of working with perfectionists and how to solve them. I have recently been working on a group project and one of the people in our group is a perfectionist, so I thought I would share my thoughts on this. I needed a few ideas, so I decided to search the world of blogs and see what other people have blogged about on the subject. Unfortunately that didn’t turn out to be as easy as I thought it would be…
A few years ago I wrote a search engine for a friend who had started his own blog - this was at the time when only the elite had blogs and before Word Press was the thing to use. The search engine I made wasn’t brilliant, but it did the job fairly well. It ranked articles based upon how many occurances of the search terms there were divided by the number of words, and how many times it occured in the title.
Last week I started with the search engine for Juvely, I based it upon this, because this is what I had known and loved. After a while I decided to start from scratch because it was too limited, my useful old search engine didn’t even handle grouping terms by quotations. :p The new version uses basically the same SQL queries, but the idea of ranking that I used before also didn’t work for this situation, instead I opted for a ranking system based upon the number of results that link together (it sounds complicated but it makes a lot of sense if you understand how Juvely works).
Now, back to my problem. My blog search for information about perfectionists turmned up appaling search results. I tried searching on a certain web search engine for more information which seemed a lot better, but it wasn’t really what I was after - I wanted to see what other people had blogged about the subject.
I was rather appalled at how bad the results I got from the blog search engines were so I decided to try a little experiment. I guess the reason why I didn’t get much information about perfectionists was because it isn’t a very blogged about topic, so I choose a different one and decided to see how a number of web and blog search engines compare.
A highly blogged about topic was the Google takeover of YouTube, so I decided to use google bid for youtube as my search query. If we do a search on three major web search engines (Google, Yahoo, MSN) we get good matching results. Now, if we try the same with blog search engines (Google Blogsearch, Technorati, Bloglines, Sphere) we don’t really get any good matches. On Google Blogsearch the first result is about a presidential bid on YouTube, on Bloglines why YouTube is struggling, on Sphere a load of links, and let’s not even get into Technorati.
The problem seems to be that most of these search engines rank newer posts much more important than older ones, even if they are completely irrelevant to the topic being searched for. Maybe this works for most users, but for me it didn’t. So i’ll go back to the title of this and say that there is still room in this cramped Web 2.0 for a good blog search engine, and yep, if you are really good you can even beat Google at their game.
Although I may understand why I didn’t get any good results, it still doesn’t help in my quest for information. So if anyone knows of a good blog search engine (or just what I am doing wrong) post a comment!