Because we witness the processing requirements of big data exceeding the capabilities of most current machines, building up such a huge processing architecture involves several challenges in terms of both the hardware and software deployments.
The sheer quantity of data exceeds the capacity for analyzing that data in many organizations.
Gartner analyst Doug Laney has characterized Big Data as "data that's an order of magnitude greater than data you're accustomed to". Ed Dumbill, program chair for the O'Reilly Strata Conference, describes Big Data as, "data that exceeds the processing capacity of conventional database systems.
As one of the people responsible for early definitions, I wrote in January 2012 that big data is "data that exceeds the processing capacity of conventional database systems.
We can define big data to be data that exceeds the processing capacity of conventional database and analytics technology (in that the data is unstructured, too large or too fast).
Big Data generally refers to data that exceeds the typical storage, processing, and computing capacity of conventional databases and data analysis techniques.
"Big data is a form of data that exceeds the processing capabilities of traditional database infrastructure or engines" [20]. . Figure 2 shows the employment of big data applications in smart cities. Smart city applications generate huge amounts of date while big data systems utilize this data to provide information to enhance smart cities applications.
Wikibon.org research estimates that the Big Data market exceeded $5 billion in revenue in 2011 and expects that by 2017, revenues from Big Data will increase 10-fold.
Big Data, the new buzz word in the industry, is data that exceeds the processing and analytic capacity of conventional database systems within the time necessary to make them useful.
The term "big data" refers to the agglomeration of large and complex data sets, which exceeds existing computational, storage and communication capabilities of conventional methods or systems.
