
Thursdays on AltSearchEngines we welcome a Guest Author to our blog. Today we are fortunate to have Bob Warfield of the SmoothSpan Blog.
Bob recently published a two-part series entitled, Why Don’t Search Startups Share Data? (aka Open Source Style Web Crawling) One of the basic tenets of AltSearchEngines is to encourage greater communication and cooperation amongst the Alternative Search Engines for the mutual benefit of all
Here’s Part I (tomorrow is Part II):
New Jersey Search Engine startup Accoona is filing for IPO after just a few short years of operation. Whether you think they’re a good investment or not, there’s definitely some feeling there’s gold left in them thar hills and the Googleplex hasn’t taken it all yet.
At the same time, there is an interesting discussion on Skrentablog that asks if there are 100 alternate search engines how come only about 11 seem to be crawling the net? Accoona is one of the 11 actually detected, BTW. Richard MacManus is similarly perplexed, and his Read/WriteWeb blog post considers some possible explanations, but winds up baffled.
I appreciate the mystery. Are these niche search engines that just haven’t hit all the sites? Are they purchasing their index from somewhere? Do they know some other way besides crawling to create an index? Are they really smart about not crawling until a page changes somehow? And does this deafening silence from crawlers indicate that the Googles and Yahoo!s of the world really have sewn up the search world, that you have to be big to do it, and that others need not apply? Read the rest of this entry »
























