Thursday, September 13, 2007

Trends 2007: Megadata

Today it's obvious we now have massive computing power, the amount of data we work on even for personal use is growing larger. How we will process the volume?

Joe Gregorio coined the term "megadata", that is large data sets, where traditional relational techniques (triggers, transactions, joins, are NOT used). For example, Google's use of BigTable.

Moreover, the common themes here are that the "structure" of structured data is different: it is inherently distributed, and de-normalized, (which brings to mind the Cal Henderson statement on normalized data)

No comments: