Loading [MathJax]/jax/output/HTML-CSS/fonts/TeX/fontdata.js

Big Data

what is big data

collection of data sets so large and complex that it becomes difficult to process using traditional data processing applications

Data model

then

      few companies were generating data and all others were consuming

now

       all of us are generating data and all of us are consuming

 

data types

   structural data

   unstructural data

   semi structural data

big data analytics   

   big data analytics is the process of examining large datasets to uncover hidden patterns, unknown correlations, market trends, customer preferences and other useful business information 

 

NOSQL

why we move into NOSQL

scalability

SQL vs NOSQL

SQL

SQL stands for structured query language

SQL lets you access and manipulate databases

SQL is an ANSI standard

 

NOSQL

stands for Not Only SQL 

class of non-relational data storage systems

usually do not require a fixed table schema nor do they use the concept of joins

all NOSQL offerings relax one or more of the ACID properties

 

NOSQL characteristic

open-source

non-relational

schema-less

cluster friendly

 

CAP vs ACID theorem

ACID

Atomicity

Consistency

Isolation

Durability

CAP

Consistency

Availability

Partition tolerence

 

NOSQL database Types

document

column-family

graph

key-value

 

Lecture 07

Harsha  Rathnayaka
Module by Harsha Rathnayaka, updated more than 1 year ago
No tags specified