Flashcards
NoSQL
Flashcards do conjunto (83)
- 1Big data embodies new data characteristics created by today's ------digitized marketplace.
- 2What are the characteristics of Big Data? the Vs........Volume - Data@Scale
Variety -Data In many forms
Velocity - Data in motion
Veracity- Data Uncertainty - 3We are in the age of ------- data?Zettabyte
- 4data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed timeBig Data
- 5Data volume is increasing ------exponentially
- 6What are the challenges in handling Big data?- Technology
- Technical Skills. - 7What was the problem of the traditional system?Time required to copy data across multiple systems.
- 8What are the requirements for a new approach?Partial failure support.
Data recoverability.
Component recoverability.
Consistency.
Scalability. - 9What was the radical approach to the problem of distributed computing?Google's Hadoop Framework
- 10Concepts of Hadoop?High-level-Code
Shared Nothing Architecture
Data shared in advance of computation.(64MB/128MB) per block - 11If a node is running slow the master can redundantly execute another instance, this is know as --------?Speculative Execution.....
The results from first to finish will be used. - 12RDBMS were not designed for distributed systems, mention 2 multi-node DB solution for scaling out/ horizontal scaling?- Master-Slave,
- Sharding. - 13What are the other ways to scale RDBMS?Multi-Master Replication
Insert Only, no Updates/Deletes
No Joins (De-normalization)
In-Memory Databases. - 14What is NoSQL?Stands for "Not Only SQL"
- 15What are the characteristics of NoSQL DBs?Non- relational DBs
No fixed table schema
No join concepts
Relax one/more of ACID properties. - 16SQL Join combines -----records from two/more tables in a database.
- 17Mention 4 types of Joins?Inner Join
Outer Join
Right Join
Left Join - 18Horizontal Scaling means -----you scale by adding more machines to your pool of resources.
- 19Vertical Scaling means -----that you scale by adding more power (CPU, RAM, etc.) to your existing machine.
- 20Give an example of vertical scaling ?MySQL-Amazon RDS -
(The cloud version of MySQL)
provides an easy way to scale vertically by switching from small to bigger machines, but this process often involves downtime. - 21What is ACID?Is a set of properties that you would like to hold when modifying a database via a transaction.
- 22ACID means?Atomicity
Consistency
Isolation
Durability - 23Atomicity means ----that you can guarantee that all of a transaction happens, or none of it does.
- 24Consistency means ----that you can guarantee that your data will be consistent.
- 25Isolation means ------that one transaction cannot read data from another transaction that is not yet completed.
- 26Durability means -----that once a transaction is complete, it is guaranteed that all of the changes have been recorded to a durable medium (such as a hard disk), and the fact that the transaction has been completed is likewise recorded.
- 27RDMS has problem with ----- data?Unstructured and Semi-Structured data.
- 28The CAP theorem states that there are ----- basic requirements which exist in a special relation when designing applications for a distributed architecture.3
- 29Consistency - This means that ----the data in the database remains consistent after the execution of an operation.
- 30Availability - This means that ----the system is always on (Service guarantee availability), no downtime.
- 31Partition Tolerance - This means that -----the system continues to function even if the communication among the servers is unreliable.
- 32Generally, ----------- to fulfill all three requirements in a distributed system.it is not be possible
- 33Distributed systems must be -------, so we have to choose between Consistency and Availability.partition tolerant (P)
- 34A network partition can occur when a -------------- causes a collection of nodes to be divided into two sub-collections that are isolated from each other.network failure
- 35What are features of RDMS?- Structured and organized data
- Structured query language (SQL)
- Data and its relationships are stored in separate tables.
- Data Manipulation Language, Data Definition Language
- Tight Consistency
- ACID Transaction - 36What are the features of NoSQL?NoSQL
- Stands for Not Only SQL
- No declarative query language
- No predefined schema
- Variants - Key-Value Pair Store, Column Store, Document Store, Graph Store
- Eventual consistency rather ACID property
- Unstructured and unpredictable data
- CAP Theorem
- Prioritizes high performance, high availability and scalability - 37Mention the different types of NoSQL DBs?Key-Value Systems -DynamoDB.
Document-based Systems -Mongo/Couch.
Column-based Systems -BigTable/Casandra.
Graph-based Systems -Neo4j,G-Pregel.
Multi-Model Systems- OrientDB - 38KVP basic operations include ------Insert(key,value)
Fetch(key)
Update(key)
Delete(key). - 39In KV pair the --- is responsible for understanding the data stored, as a blob?application
- 40Dynamo uses -----on key to generate a 128 bit identifier to determine the storage node?MD5 hash
- 41What is the data model for Document-based Systems?(key, document)
- just like KV but value is now document. - 42What are the basic operation for Document Systems?Insert (key, document)
Fetch(key)
Update(key)
Delete(key) - 43Unlike KV pair both the key and document are ---- in document-based?fully searchable
- 44Column-based are also known as -------Wide -Column Stores
- 45What is the lowest/smallest instance, that is a tuple & contains a name, a value and a timestamp, in Wide Column Model.The Column.
- 46This type of data store is good for -----Distributed data storage, especially versioned data because of the time-stamps.
- 47What are the data models for graph based systems?Nodes and Edges.
- 48In Graph databases, index-free adjacency means.....?This means that every element contains a direct pointer to its adjacent element and no index lookups are necessary
- 49There is no universal query language like ---- in Nosql databases.SQL
- 50Each NoSQL product does things ---------differently
- 5140+ years versus 6+ yearsRelational databases are very mature
- 52------ is a class of modern RDMS that seeks to provide the same scalable performance of NoSQL systems for online transaction?NewSQL as used by by 451 Group.
- 53A software framework for storing, processing, and analyzing “big data”Apache Hadoop
- 54Problems of the traditional RDBMS areHuge data.
Difficult to coding in parallel computing env.
It take longer time to copy data across. - 55Requirements for the new system.....The system must support partial failure.
If a component fails, then recovers,its should be able to rejoin d system wtout restarting entire system.
Component failure should affect job result.
Easy Scalability. - 56Concepts of Hadoop -----------Application written in high-level code
Shared Nothing Architecture
Data is spread among machines in advance.
Data split in blocks of 64MB/128MB
Map tasks works on single block.
Master node reassign work to another node in case of failure. - 57What can you do with Hadoop?Business Intelligence
Advanced Analytic
Applications
Data Processing & Storage. - 58Where does the data comes from?Science
Industry
Legacy
System Data - 59Common Analysis with Hadoop include-----Text Mining
Sentiment Analysis
Prediction Models
Pattern Recognition
Graph Creation & Analysis
Index Building
Risk Assessment
Collaborative Filtering - 60Nature of Data are --------Velocity-speed
Volume-quantity
Variety -different
Veracity -doubt - 61What are the 2 core components of Hadoop?The HDFS ----store data on cluster
MapReduce ----process data on cluster - 62Mention other projects based around Hadoop -also referred to as Hadoop Ecosystem?Hive
Pig
Flume
HBase
Sqoop
Oozie - 63HDFS is written in java, based on Google's GFS & sits on top of native FS such asext3, ext4 or xfs
- 64---- is the Hadoop database?Hbase
- 65Flume is a service to -----move large amount of data in real time/ to hdfs.
- 66Spark is a fast, general engine for -----large scale data processing on cluster.
Its faster than MapReduce
Good for iterative Algorithms
Can hold data in RAM
Support Python,Java,Scala
Real time streaming - 67Hive is ----SQL-like ,
uses jdbc & odbc - 68Pig Latin is ----data flow language,
uses PigServer / javaAPI - 69Oozie is a -----work flow engine for MapReduce jobs.
- 70Mahout is -----Machine learning library written in java.
- 71A ------ is a program running on a node?daemon
- 72Name the 3 main properties of Distributed Systems?Consistency
Availability
Partition Tolerance. - 73All nodes have up-to-date view of data......Consistency.
- 74Every request receives a response ......Availability.
- 75System will continue to function if partitions are isolated from each other .....Partition Tolerance.
- 76Explain the ACID principle based on CAP theorem used for relational DBs transactions.Atomicity - all or nothing.
Consistency - data always in valid state
Isolation-concurrent trans. are isolated
Durability-once completed changes are permanent. - 77Nosql supports BASE instead of ACID...What is BASE?Basically Available Soft-state Eventual Consistency.
- 78You must have at most ---- of the CAP properties for any shared data system.2
- 79-------- is a common characteristics of most NOSQL storage systems?No Schema
- 80What is Data Model?Data Model -- collection of concepts for describing data.
- 81What is a schema?A schema --description of a particular collection of data, using a given data model.
- 82What are the steps in Database Design?Requirements Analysis
Conceptual Design
Logical Design
Schema Refinement
Physical Design
Security Design. - 83—
Informações
- Descrição
- FlashCards sobre NoSQL, criado por Abolanle Sule em 22-02-2017.
- Criado por
- Abolanle Sule
- Visualizações
- 16
- Avaliação