Google announced that it has completed a new web indexing system called Caffeine. With Caffeine Google can give us 50 percent fresher results for google searches when compared to the old indexing system. When Google performs searches for queries, it does not search the real web. Instead Google searches its own version of the web indexed by Google. Google creates this index by frequently crawling many billions of websites.
Web is evolving constantly. It is not static. Nowadays with all the real time updates, like blogs and tweets, web is more dynamic than ever. Often when we search we need the latest real time information. Google said,
To keep up with the evolution of the web and to meet rising user expectations, we’ve built Caffeine.
The old web indexing system is not real time search friendly and Google has to develop a new system for the evolving web. With caffeine , now one can get a relevant page as a search “result much sooner after it is published than ever before”. Google explained that
Our old index had several layers, some of which were refreshed at a faster rate than others; the main layer would update every couple of weeks. To refresh a layer of the old index, we would analyze the entire web, which meant there was a significant delay between when we found a page and made it available to you.
With Caffeine, we analyze the web in small portions and update our search index on a continuous basis, globally. As we find new pages, or new information on existing pages, we can add these straight to the index. That means you can find fresher information than ever before—no matter when or where it was published.
The amount of data the new system Caffeine can process mind boggling amount of data. Google says,
In every second hundreds of thousands of web pages in second. If this were a pile of paper it would grow three miles taller every second.” Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day. You would need 625,000 of the largest iPods to store that much information; if these were stacked end-to-end they would go for more than 40 miles.
With Caffeine the Google search experience will get better soon.
Related posts:
- Google Panda on the Prowl Again to Serve the Search Results Hot
- Google’s Ultra High Speed Fiber Network Goes to Kansas City
- Google Health Gets a New Look
- Google Search to Get More Social
- Google Unveils +1 to Make Search and Ads Social
- Google Hits Back at WSJ Report: Google is for Users, Not Websites
- Google Wants to Hire Autocompleters