What's That Noise?! [Ian Kallen's Weblog]

Main | Next day (Jun 6, 2004) »

Saturday June 05, 2004

Managing Terabytes How does google do it? Indexing <sagan>billions and billions</sagan> of documents everyday isn't easy.

Apparently, one component of the Secret Sauce is the Google File System. Some have even gone on to extrapolate some projections of how they do what they do from the SEC filings. The challenges of managing gigabytes terabytes are impressive, indeed. ( Jun 05 2004, 11:58:01 PM PDT ) Permalink

Contact:
spidaman < at > arachna.com

Technorati

Who?

I'm Ian Kallen. I'm an entrepreneur and technologist working on Blockboard. My technical interests are focused on mobile, location, cloud computing, big data, real time event systems, search, devops and agile web application code. I'm a long time open source enthusiast and enjoy right-sizing code architecture and infrastructure with the scope and stage a technology startup is operating at.

Previously, I was an independent technology consultant. Prior to that, I did a long stint with Technorati leading the Core Services engineering group in architecting a backend to support search and exploring the web as it changes in real time. I have an eclectic background in technology, publishing, social software and ... life. I like to think: well rounded. I have been online participating in virtual communities since 1988 and developing online resources, services and systems as well as enterprise software since 1991. Once in a while, I have time and inspiration to blog.

The views expressed here are not necessarily those of any present or past employers. KTHXBAI

Feed: