The day is finally here!  We are now live, beta has exited, 1.0 is a go! Before I go any further, I want to thank the many beta users that helped us over the last several months by providing feedback, suggestions for improvements, and identifying bugs.  Without your help, we wouldn’t have been able to get 80legs to where it is today.

During the private beta, we were working on several features, all of which are now ready for public use.

These features are:

• True web-scale crawling: crawl up to 2 billion pages per day
• Usability: easily and design your own crawls using an intuitive job form
• 80Apps: write and run your own applications on over 50,000 computers
• API: programmatically control 80legs to work for you

80legs opens up a world of possibilities for developers. What would you do if you had the crawling and processing power of Google, Yahoo, or Microsoft? 80legs gives that power to you.

Potential applications.

* Semantic Search
* Media Analysis
* Market Research
* And Much More

The “semantic web” is gaining ground as an emerging trend of technology. While providing rich data markup lies on one end of the semantic spectrum, making sense of the highly unstructured nature of the web lies at the other.

Crawling and process unstructured content on the web is a daunting task faced by any firm wanting to apply semantic and natural language processing to web content. While semantic firms know how to process that content, they have difficulty doing so quickly and affordably.

80legs can help. By tapping into 50,000 computers, semantic firms can quickly and affordably crawl and process large volumes of unstructured data and make sense of billions of web page

There’s also one big change that comes with leaving beta – 80legs is no longer completely free to use.  Our pricing is now in effect.  You can still dip your toes in the water and run jobs that crawl less than 100 pages.