Sem título

BIG DATA

1. Definition

   •    Big data is the term for a collection of data sets so large and complex. That it becomes difficult to process using on-hand database management tools or traditional data processing applications.   

2. Development

   • Government sector for example, recently released a report that gives organizations guidelines for an effective government big data program. 
   • Private sector       Google       Facebook       Amazon
   • Government sector
     •    In 2012, the Obama administration announced the Big Data Research and Development Initiative, which explored how big data could be used to address important problems faced by the government.[46] The initiative was composed of 84 different big data programs spread across six departments.[47]   
   • Private sector
     •    Amazon.com handles millions of back-end operations every day, as well as queries from more than half a million third-party sellers. Walmart handles more than 1 million customer transactions every hour, which is imported into databases estimated to contain more than 2.5 petabytes. Facebook handles 50 billion photos from its user base.
   • International
     •    Research on the effective usage of information and communication technologies for development (also known as ICT4D) suggests that big data technology can make important contributions but also present unique challenges to International development.   
     • Advancement
       •    big data analysis offer cost-effective opportunities to improve decision-making in critical development areas such as health care, employment, economic productivity, crime, security, and natural disaster and resource management.   

3. Market

   •    Big Data" has increased the demand of information management specialists in that Software AG, Oracle Corporation, IBM, Microsoft, SAP, EMC, HP and Dell have spent more than $15 billion on software firms only specializing in data management and analytics. Developed economies make increasing use of data-intensive technologies. There are 4.6 billion mobile-phone subscriptions worldwide and there are between 1 billion and 2 billion people accessing the internet.   

4. Architecture

   •    In 2004, Google published a paper on a process called MapReduce that used such an architecture.   
   • MapReduce
     •    MapReduce framework provides a parallel processing model and associated implementation to process huge amount of data.   

5. Technologies

   •    Big data requires exceptional technologies to efficiently process large quantities of data within tolerable elapsed times. Multidimensional big data can also be represented as tensors, which can be more efficiently handled by tensor-based computation,such as multilinear subspace learning.   

6. Problems

   • Unstructured data
   • NoPrivacy
   • Usuability

7. Challenges

   • Storage
   • Visualization
   • Analysis
   • Capture

8. Trends

   •    The trend to larger data sets is due to the additional information derivable from analysis of a single large set of related data, as compared to separate smaller sets with the same total amount of data. Allowing correlations to be found to "spot business trends, determine quality of research, prevent diseases,  combat crime, and determine real-time roadway traffic conditions.