Modulo 2 - Big Data Analysis & Technology Concepts

Description

Modulo 2
Juan Taborda
Quiz by Juan Taborda, updated more than 1 year ago
Juan Taborda
Created by Juan Taborda about 7 years ago
153
1

Resource summary

Question 1

Question
Big Data Analysis
Answer
  • differs from traditional data analysis primarily because of the volume, velocity and variety characteristics of the data it processes
  • When two variables are considered to be _____________ they are considered to be aligned based on a linear relationship
  • This means that when one variable changes, the other variable also changes proportionally and constantly
  • this helps maintain data provenance throughout the big data analysis lifecycle, which helps establish and preserve data accuracy and quality

Question 2

Question
step-by-step process
Answer
  • is needed to organize the task involved with retrieving, processing, producing and repurposing data
  • therefore, it is advisable to store a verbatim copy of the original dataset before proceeding with the filtering. To save on required storage space, the verbatim copy is compressed before storage
  • Although the data format may be the same, the data model may be different
  • depending on the business scope of the analysis project and nature of the business problems being addressed, the requiered datasets and their sources can be internal and/or external to the enerprise

Question 3

Question
Big Data Analysis Lifecycle
Answer
  • Business Case Evaluation
  • Data Identification
  • A/B Testing
  • An ________ is employed when the comparatively simple data manipulation functions of a query engine are insufficient

Question 4

Question
Big Data Analysis Lifecycle
Answer
  • Data Adquisition & Filtering
  • Data Extraction
  • suggestions commonly pertain to recommending items, such as movies, books, web pages, people, etc.
  • the processing engine mechanism will often use the ___________ to coordinate data processing across a large number of servers. This way, the processing engine does not require its own coordination logic

Question 5

Question
Big Data Analysis Lifecycle
Answer
  • Data Validation & Cleansing
  • Data Aggregation & Representation
  • The ______ itself is a visual, color-coded representation of data values
  • the processing engine mechanism will often use the ___________ to coordinate data processing across a large number of servers. This way, the processing engine does not require its own coordination logic

Question 6

Question
Big Data Analysis Lifecycle
Answer
  • Data Analysis
  • Data Visualization
  • A _______ is generally expressed using a line chart, with time plotted on the x-axis and recorded data value plotted on the y-axis
  • Utilization of Analysis Results

Question 7

Question
Business Case Evaluation
Answer
  • requires that a business case be created, assessed and approved prior to proceeding with the actual hands-on analysis task
  • helps decision-makers understand the business resources that will need to be utilized and which business challenges the analysis will tackle
  • Unstructured text is generally much more difficult to analyze and search, compared to structured text
  • is an example of the application of the law of large numbers

Question 8

Question
Business Case Evaluation
Answer
  • the further identification of KPI during this stage helps determine how closely the data analysis outcome needs to meet the identified goals and objectives
  • based on the business requirements documented, it can be determined whether the business problems being addressed are really Big Data problems
  • Applications for ___________ include fraud detection, medical diagnosis, network data analysis and sensor data analysis
  • can be applied to the categorization of unknown documents, and to personalized marketing campaings by grouping together customers with similar behavior

Question 9

Question
Business Case Evaluation
Answer
  • in order to qualify as a Big Data Problem, a business problem needs to be directly related to one or more of the Big Data characteristics of volume, velocity or variety
  • Note also that another outcome of this stage is the determination of the underlying budget required to carry out the analysis project
  • The processing engine enables data to be queried and manipulated in other ways, but to implement this type of functionality requires custom programming
  • Workflow Engine

Question 10

Question
Business Case Evaluation
Answer
  • any required purchase of tools, hardware, training, etc. need to be understood in advance, so that the anticipated investment can be weighed against the expected benefits of archieving the goals
  • initial iteration of the big data analysis lifecycle will require more up-front investment of Big Data technologies, products and training compared to later iterations where these earlier investment can be repeatedly leveraged
  • In the context of traditional data analysis, the ______ states that, starting with a reasonably large sample size, the value obtained from the analysis of additional data decreases as more data is successively added to the original sample
  • can be applied to the categorization of unknown documents, and to personalized marketing campaings by grouping together customers with similar behavior

Question 11

Question
Data Identification
Answer
  • is dedicated to identify datasets (and their sources) required for the analysis project
  • identifying a wider variety of data sources may increase the probability of finding hidden patterns and correlations
  • Classification, outlier detection, filtering, natural language processing, text analytics and sentiment analysis can utilize ___________
  • Clustering

Question 12

Question
Data Identification
Answer
  • it can be beneficial to identify as many types of related data sources and insights as possible, especially when we dont know exactly what we're looking for
  • depending on the business scope of the analysis project and nature of the business problems being addressed, the requiered datasets and their sources can be internal and/or external to the enerprise
  • examples of appenden metadata can include dataset size and structure, source information, date and time of creation or collection, language-specific information, etc.
  • is generally used in data mining to get an understanding of the properties of a given dataset. After developing this understanding, classification can be used to make better predictions about similar, but new or unseen data

Question 13

Question
Internal Datasets
Answer
  • a list of available datasets from sources, such as data marts and operational systems, are typically compiled and matched against a predefined dataset specification
  • A distributed Big Data solution that needs to run on multiple servers relies on the coordination engine mechanism to ensure operational consistency across all of the participating servers
  • Subsequent to __________ being made available to business users to support business decision-making (such as via dashboard), there may be further oportunities to utilize the __________
  • In other areas such as the scientific domains, the objective may simply be to observe which version works better in order to improve a process or product

Question 14

Question
External Dataset
Answer
  • a list of possible third-party data providers (data markets and publicity available datasets), are generally compiled. Some forms of external data may be embedded within blogs or other types of content-based Websites, in which case they may need to be harvested via automated tools
  • can be applied to the categorization of unknown documents, and to personalized marketing campaings by grouping together customers with similar behavior
  • Reconciling these differences can require complex logic that is executed automatically without the need for human intervention
  • A big data _________ utilizes a distributed parallel programming framework that enables it to process very large amounts of data distributed across multiple nodes

Question 15

Question
Data adquisition & filtering
Answer
  • the data is gathered from all of the data sources that were identified during the previous stage and is then subjected to the automated filtering of corrupt data or data that has been deemed to have no value to the analysis objectives
  • depending on the type of data source, data may come as a dump of files (such as data purchased from a third-party data provider), or may require API integration (such as with Twitter)
  • A ________ engine enables data to be moved in or out big data solution storage devices
  • A _________ comprises grouped read/writes, with a larger data footprint consisting of complex joins and high-latency responses

Question 16

Question
Data adquisition & filtering
Answer
  • In many cases, especially where external, unstructured data is concerned, some or most of the acquired data may be irrelevant (noise) and can be discarded as par of the filtering process
  • data classified as "corrupt" can include records with missing or nonsensical values or invalid data types
  • it involves plotting entities as nodes and connections as edges between nodes
  • OLTP and operational systems (write-intensive) as well as operational BI and analytics (read-intensive), both fall within this category

Question 17

Question
Data adquisition & filtering
Answer
  • data that is filtered out for one analysis may possibly be valuable for a different type of analysis
  • therefore, it is advisable to store a verbatim copy of the original dataset before proceeding with the filtering. To save on required storage space, the verbatim copy is compressed before storage
  • is an example of the application of the law of large numbers
  • Coordination Engine

Question 18

Question
Data adquisition & filtering
Answer
  • both internal and external data needs to be persisted once it gets generated or enters the enterprise boundary
  • for batch analytics, this data is persisted to disk prior to analysis
  • extracting text for text analytics, which requires scans of whole documents, will not be necessary if the underlying Big Data solution can already read the document in its native format directly
  • is dedicated to determining how and where processed analysis data can be further leveraged

Question 19

Question
Data adquisition & filtering
Answer
  • in the case of realtime analytics, the data is analyzed first and then persisted to disk
  • metadata can be added via automation to data from both internal and external data sources to improve the classification and querying
  • Also known as offline processing, ________ processing involves processing data in batches and usually imposes delays (resulting in high-latency responses)
  • is generally applied via the following two approaches: collaborative ____________ and content-based ____________

Question 20

Question
Data adquisition & filtering
Answer
  • examples of appenden metadata can include dataset size and structure, source information, date and time of creation or collection, language-specific information, etc.
  • it is vital that metadata be machine-readable and passed forward along subsequent analysis stages
  • The ability to analyze massive amounts of data and find useful insights carries little value if the only ones that can interpret the results are the analysis
  • both version are subjected to an experiment simultaneously, the observations are recorded to determine which version is more successful

Question 21

Question
Data adquisition & filtering
Answer
  • this helps maintain data provenance throughout the big data analysis lifecycle, which helps establish and preserve data accuracy and quality
  • metadata is added through an automated mechanism to data received from both internal and external data sources
  • any required purchase of tools, hardware, training, etc. need to be understood in advance, so that the anticipated investment can be weighed against the expected benefits of archieving the goals
  • helps decision-makers understand the business resources that will need to be utilized and which business challenges the analysis will tackle

Question 22

Question
Data Extraction
Answer
  • Some of the data identified as input for the analysis may arrive in a format incompatible with the big data solution
  • the need to address disparate types of data is more likely with data from external sources
  • make it possible to develop highly reliable, highly available distributed big data solutions that can be deployed in a cluster
  • Data needs to be imported before it can be processed by the big data solution

Question 23

Question
Data Extraction
Answer
  • is dedicated to extracting disparate data and transforming it into a format that the underlying big data solution can use for the purpose of the data analysis
  • the extend of extraction and transformation required depends on the types of analytics and capabilities of the big data solution
  • provenance can play an important role in determining the accuracy and quality of qustionable data
  • is closely related to parallel data processing in how the same principle of "divide-and-conquer" is applied

Question 24

Question
Data Extraction
Answer
  • extracting text for text analytics, which requires scans of whole documents, will not be necessary if the underlying Big Data solution can already read the document in its native format directly
  • further transformation is needed in order to separate the data into two separate fields as required by the big data solution
  • it can also be used to make predictions about the values of the dependent variable while it is still unknown
  • However, ___________ is always archieved through physically separate machines that are networked together as a cluster

Question 25

Question
Data Validation & Cleansing
Answer
  • Invalid data can skew and falsify analysis results
  • Unlike traditional enterprise data where the data structure is pre-defined and data is pre-validated, data input into big data analyses can be unstructured without any indication of validity
  • More than one independent variable can be tested at the same time
  • The _______ essencially acts a resource arbitrator that manages and allocates available resources

Question 26

Question
Data Validation & Cleansing
Answer
  • its complexity can further make it difficult to arrive at a set of suitable validation constraints
  • is dedicated to establishing (often complex) validation rules and removing any known invalid data
  • is closely related to the concept of classificatopm and clustering, although its algorithms focus on finding abnormal values
  • for batch analytics, ______________ can be achieved via an offline ETL operation

Question 27

Question
Data Validation & Cleansing
Answer
  • Big data solutions often receive redundant data across different datasets
  • this redundancy can be exploited to explore interconnected datasets in order to assemble validation parameters and fill in missing valid data
  • A ___ represents a geographic measure by which different regions are color-coded according to a certain theme
  • A _________ is a file system that can store large files spread across a cluster

Question 28

Question
Data Validation & Cleansing
Answer
  • for batch analytics, ______________ can be achieved via an offline ETL operation
  • The presence of invalid data is resulting in spikes. Although the data appears abnormal, it may be indicative of a new pattern
  • A _______ is generally expressed using a line chart, with time plotted on the x-axis and recorded data value plotted on the y-axis
  • for realtime analytics, a more complex in-memory system is required to validate and cleanse the data at the source

Question 29

Question
Data Validation & Cleansing
Answer
  • provenance can play an important role in determining the accuracy and quality of qustionable data
  • data that appears to be invalid may still be valuable in that it may possess hidden patterns and trends
  • No hypothesis or predetermined assumptions are generated
  • A _______ database is a non-relational database that is highly scalable, fault-tolerant and specifically designed to house unstructured data

Question 30

Question
Data Aggregation & Representation
Answer
  • Data may be spread across multiple datasets, requiring that datasets be joined together via common fields, in other cases, the same data fields may appear in multiple datasets
  • Either way, a method of data reconciliation is required or the dataset representing the correct value needs to be determined
  • Law of Diminishing Marginal Utility
  • A ______ can be in the form of a chart or a map

Question 31

Question
Data Aggregation & Representation
Answer
  • is dedicated to integrating multiple datasets together to arrive at a unified view
  • future dara analysis requirements need to be considered during this stage to help foster data reusability
  • The ________ mechanism can also be used for support distributed locks, support distributed queues, establish a highly available registry for obtaining configuration information, reliable asynchronous communication between processes that are running on different servers
  • essentially provides the ability to discover text rather than just search it

Question 32

Question
Data structure and Semantics
Answer
  • performing the stage of data aggregation & representation can become complicated because of differences in this
  • Reconciling these differences can require complex logic that is executed automatically without the need for human intervention
  • Within Big Data ________ can first be applied to discover if a relationship exists
  • both version are subjected to an experiment simultaneously, the observations are recorded to determine which version is more successful

Question 33

Question
Data structure
Answer
  • Although the data format may be the same, the data model may be different
  • are an effective visual analysis technique for expressing patterns, data compositions via part-whole relations and geographic distributions of data
  • Data Adquisition & Filtering
  • Hadoop's batch-based data processing fully lends itself to the pay -per-use model of __________, which can reduce operational costs since a typical Hadoop cluster size can range from a few to a few thousand nodes

Question 34

Question
Semantics
Answer
  • A value that is labelled differently in two different datasets may mean the same thing
  • Instead of hard-coding the required learning rules, either supervised or unsupervised machine learning is applied to develop the computer's understanding of the __________
  • Network Analysis
  • In other areas such as the scientific domains, the objective may simply be to observe which version works better in order to improve a process or product

Question 35

Question
Data Aggregation
Answer
  • The large volumes processed by Big Data solutions can make____________ a time and effort-intensive operation
  • Whether _____________ is required or not, it is important to understand that the same data can be stored in many different forms. One form may be better suited for a particular type of analysis than another
  • require processing resources that they request from the resource manager
  • the data is then analyzed to prove or disprove the hypothesis and provide definitive answers to specific questions

Question 36

Question
Data structure standarized
Answer
  • can act as a common denominator that can be used for a range of analysis techniques and projects. This can require establishing a central, standard analysis repository, such as a NoSQL database
  • A big data _________ utilizes a distributed parallel programming framework that enables it to process very large amounts of data distributed across multiple nodes
  • The _____ essencially acts a resource arbitrator that manages and allocates available resources
  • comprise random read/writes that involve fewer joins and require low-latency responses, with a smaller data footprint

Question 37

Question
Data Analysis
Answer
  • is dedicated to carrying out the actual analysis task, which typically involves one or more types of analysis
  • this stage can be iterative in nature, especially if the _________________ is exploratory so that analysis is repeated until the appropiate pattern or correlation is uncovered
  • A _______ may internally use a processing engine to process multiple large datasets in parallel
  • the accuracy and applicability of the patterns and relationships that are found in a large dataset will be higher than that of a smaller dataset

Question 38

Question
Data Analysis
Answer
  • the exploratory analysis approach is explained shortly, along with confirmatory analysis
  • depending on the type of analytics required, this stage can be as simple as querying a dataset to compute an aggregation for comparision
  • make it possible to develop highly reliable, highly available distributed big data solutions that can be deployed in a cluster
  • Correlation, regression, time series analysis, classification, clustering, outlier detection, filtering, natural language processing, text analytics and sentiment analysis are considered forms of ________

Question 39

Question
Data Analysis
Answer
  • it can be as challenging as combining data mining and complex statistical analysis techniques to discover patterns and anomalies, or to generate a statistical or mathematical model to depict relationship between variables
  • The approach taken when carrying out this stage can be classified as confirmatory analysis or exploratory analysis (the latter is linked to data mining)
  • The results of completing the _______________ stage provide users with the ability to perform visual analysis, allowing for the discovery of answers to questions that users have not yet even formulated
  • A given ______ may support either data ingress or egress functions

Question 40

Question
Confirmatory Data Analysis
Answer
  • _____________ is a deductive approach where the cause of phenomenon being investigated is proposed beforehand
  • the data is then analyzed to prove or disprove the hypothesis and provide definitive answers to specific questions
  • can be used to determine the number of entities that fall within a certain radius of another entity
  • can act as a common denominator that can be used for a range of analysis techniques and projects. This can require establishing a central, standard analysis repository, such as a NoSQL database

Question 41

Question
hypothesis
Answer
  • The proposed cause or assumption is called a ____________
  • is an item filtering technique based on the collaboration (merging) of users' past behavior
  • This type of environment is provided by a platform that is comprised of a set of distributed storage and processing technologies
  • As the amount of digitized documents, e-mails, social media posts and log files increases, business have an increasing need to leverage any value that can be extracted from these forms of semi-structured and unstructured data

Question 42

Question
Confirmatory Data Analysis
Answer
  • the data is then analyzed to prove or disprove the hypothesis and provide definitive answers to specific questions
  • Data samples are typically used
  • this information can then be integrated into the decision-making process
  • Unexpected findings or anomalies are usually ignored since a predetermined cause was assumed

Question 43

Question
Exploratory Data Analysis
Answer
  • _____________ is an inductive approach that is closely associated to data mining
  • No hypothesis or predetermined assumptions are generated
  • can be carried out via the use of supported by correlation, heat maps, time series analysis, network analysis, spatial data analysis, clustering, outlier detection, natural language processing and text analytics
  • is an item filtering technique based on the collaboration (merging) of users' past behavior

Question 44

Question
Exploratory Data Analysis
Answer
  • Instead, the data is explored through analysis to develop an understanding of the cause of the phenomenon
  • Although it may not provide definitive answers, this method provides a general direction that can facilitate the discovery of patterns or anomalies
  • represents a constant rate of change
  • Large amounts of data and visual analysis are typically used

Question 45

Question
Data visualization
Answer
  • The ability to analyze massive amounts of data and find useful insights carries little value if the only ones that can interpret the results are the analysis
  • is dedicated to using __________________ techniques and tools to graphically communicate the analysis results for efective interpretarion by business users
  • is the process of finding data that is significantly different from or inconsistent with the rest of the data within a given dataset
  • for batch analytics, ______________ can be achieved via an offline ETL operation

Question 46

Question
Data visualization
Answer
  • Business users need to be able to understand the results in order to obtain value from the analysis and subsequently have the ability to provide feedback
  • The results of completing the _______________ stage provide users with the ability to perform visual analysis, allowing for the discovery of answers to questions that users have not yet even formulated
  • Large amounts of data and visual analysis are typically used
  • is an item filtering technique focused on the similarity between users and items

Question 47

Question
Data visualization
Answer
  • The same results may be presented in a number of different ways, which can influence the interpretation of the results
  • Consequently, it is important to use the most suitable visualization technique by keeping the business domain in context
  • Another aspect to keep in mind is that providing a method of drilling down to comparatively simple statistics were generated
  • The objective is to use graphic representations to develop a deeper understanding of the data being analyzed. Specifically, it helps identify and highlight hiden patterns, correlations and anomalies

Question 48

Question
Analysis results
Answer
  • Subsequent to __________ being made available to business users to support business decision-making (such as via dashboard), there may be further oportunities to utilize the __________
  • Natural Language Processing
  • A ___________ provides the ability to design and process a complex sequence of operations that can be triggered either at set time intervals or when data becomes available
  • includes both text and speech recognition

Question 49

Question
Utilization Analysis results
Answer
  • is dedicated to determining how and where processed analysis data can be further leveraged
  • Depending on the nature of the analysis problems being addressed, it is possible for the analysis results to produce "models" that encapsulate new insights and understandings about the nature of the patterns and relationships that exist within the data that was just analyzed
  • Data Transfer Engine
  • is generally applied via the following two approaches: collaborative ____________ and content-based ____________

Question 50

Question
Utilization Analysis results
Answer
  • A model look like a mathematical equation or a set of rules
  • Models can be used to improve business process logic, application system logic and can form the basis of a new system or software program
  • A distributed Big Data solution that needs to run on multiple servers relies on the coordination engine mechanism to ensure operational consistency across all of the participating servers
  • new models may be used to improve the programming logic within existing enterprise systems or may form the basis of new systems

Question 51

Question
Input for enterprise systems
Answer
  • Filtering
  • An ________ is employed when the comparatively simple data manipulation functions of a query engine are insufficient
  • the data analysis results may be automatically (or manually) fed directly into enterprise systems to enhance and optimized their behavior and performance
  • new models may be used to improve the programming logic within existing enterprise systems or may form the basis of new systems

Question 52

Question
Business Process Optimization
Answer
  • The identified patterns, correlations and anormalies discovered during the data analysis are used to refine business processes
  • models may also lead to opportunities to improve business process logic
  • is a computer's ability to comprehend human speech and text as naturally understood by humans
  • When two variables are considered to be _____________ they are considered to be aligned based on a linear relationship

Question 53

Question
Alerts
Answer
  • Data analysis results can be used as input for existing _______ or may form the basis of new _______
  • this helps maintain data provenance throughout the big data analysis lifecycle, which helps establish and preserve data accuracy and quality
  • Text Analytics
  • Recommender systems may also be based on a hybrid of both collaborative _______ and content-based _______ to fine-tune the accuracy and effectiveness of generated suggestions

Question 54

Question
Data Analysis Techniques
Answer
  • Statistical Analysis
  • Visual Analysis
  • it can be as challenging as combining data mining and complex statistical analysis techniques to discover patterns and anomalies, or to generate a statistical or mathematical model to depict relationship between variables
  • Note that distributed file systems and databases are both on disk _________ mechanisms

Question 55

Question
Data Analysis Techniques
Answer
  • Machine Learning
  • Semantic Analysis
  • A _______ database is a non-relational database that is highly scalable, fault-tolerant and specifically designed to house unstructured data
  • Each node in the _____ has its own dedicated resources such as memory and hard drive and runs its own operating system just like a desktop computer

Question 56

Question
Statistical Analysis
Answer
  • A/B Testing
  • Correlation
  • Unstructured text is generally much more difficult to analyze and search, compared to structured text
  • Regression

Question 57

Question
Machine Learning
Answer
  • Classification
  • Clustering
  • The use of ________ can reduce development time and enables the manipulation of large datasets without the need to write complex programming logic
  • it is vital that metadata be machine-readable and passed forward along subsequent analysis stages

Question 58

Question
Machine Learning
Answer
  • Outlier Detection
  • Filtering
  • Some propietary ________ also provide specialized data analysis features, such as text analytics and machine log analysis processing
  • Hadoop's batch-based data processing fully lends itself to the pay -per-use model of __________, which can reduce operational costs since a typical Hadoop cluster size can range from a few to a few thousand nodes

Question 59

Question
Visual Analysis
Answer
  • Heat Maps
  • Time series analysis
  • examples of appenden metadata can include dataset size and structure, source information, date and time of creation or collection, language-specific information, etc.
  • can act as a common denominator that can be used for a range of analysis techniques and projects. This can require establishing a central, standard analysis repository, such as a NoSQL database

Question 60

Question
Visual Analysis
Answer
  • Network Analysis
  • Spatial Data Analysis
  • it can be based on either supervised or unsupervised learning
  • Invalid data can skew and falsify analysis results

Question 61

Question
Semantic Analysis
Answer
  • suggest that there is no relationship at all between the two variables
  • Applications of __________ include operations and logistic optimization, environmental sciences and infrastructure planning
  • Natural Language Processing
  • Text Analytics

Question 62

Question
Semantic Analysis
Answer
  • Sentiment Analysis
  • suggest that there is no relationship at all between the two variables
  • Applications for ___________ include fraud detection, medical diagnosis, network data analysis and sensor data analysis
  • Unexpected findings or anomalies are usually ignored since a predetermined cause was assumed

Question 63

Question
Statistical Analysis
Answer
  • uses statistical methods based on mathematical formulas as a means for analyzing data
  • this type of analysis is commonly used to describe datasets via summarization, such as providing the mean, median or mode of statistics associated with the dataset
  • Spatial or geospatial data is commonly used to identify the geographic location of individual entities
  • The _____ essencially acts a resource arbitrator that manages and allocates available resources

Question 64

Question
Statistical Analysis
Answer
  • it can also be used to infer patterns and relationships within the dataset, such as regression and correlation
  • is generally applied via the following two approaches: collaborative ____________ and content-based ____________
  • is a supervised learning technique by which data is classified into relevant, previously learned categories
  • We may be further interested in discovering how closely Variables A and B are related, which means we may also want to analyze the extend to which Variable B increases in relation to Variable A's increase

Question 65

Question
A/B Testing
Answer
  • also known as split or bucket testing compares two versions of an element to determine which version is superior based on a pre-defined metric
  • the element can be a range of things
  • is expressed as a decimal number between -1 to +1, which is known as the _____________ coefficient
  • Classification, outlier detection, filtering, natural language processing, text analytics and sentiment analysis can utilize ___________

Question 66

Question
A/B Testing
Answer
  • the current version of the element is called the control version, whereas the modified version is called the treatment
  • both version are subjected to an experiment simultaneously, the observations are recorded to determine which version is more successful
  • However, ___________ is always archieved through physically separate machines that are networked together as a cluster
  • Instead of hard-coding the required learning rules, either supervised or unsupervised machine learning is applied to develop the computer's understanding of the __________

Question 67

Question
A/B Testing
Answer
  • Although __________ can be implemented in almost any domain, it is most often used in marketing
  • Generally, the objective is to gauge human behavior with the goal of increasing sales
  • This is a traditional data analysis principle that claims that data held in a reasonably sized dataset provides the maximum value
  • Either way, a method of data reconciliation is required or the dataset representing the correct value needs to be determined

Question 68

Question
A/B Testing
Answer
  • In other areas such as the scientific domains, the objective may simply be to observe which version works better in order to improve a process or product
  • A ______ can be in the form of a chart or a map
  • for batch analytics, ______________ can be achieved via an offline ETL operation
  • Correlation, regression, time series analysis, classification, clustering, outlier detection, filtering, natural language processing, text analytics and sentiment analysis are considered forms of ________

Question 69

Question
Correlation
Answer
  • is an analysis technique used to determine whether two variables are related to each other
  • if they are found to be related, the next step is to determine what their relationship is
  • Query Engine
  • In general, the more learning data the computer has, the more correctly it can decipher human text and speech

Question 70

Question
Correlation
Answer
  • We may be further interested in discovering how closely Variables A and B are related, which means we may also want to analyze the extend to which Variable B increases in relation to Variable A's increase
  • The use of ________ helps to develop and understanding of a dataset and find relationships that can assist in explaining a phenomenon
  • Network Analysis
  • Data may be spread across multiple datasets, requiring that datasets be joined together via common fields, in other cases, the same data fields may appear in multiple datasets

Question 71

Question
Correlation
Answer
  • Is therefore commonly used for data mining where the identification of relationships between variables in a dataset leads to the discovery of patterns and anomalies
  • This can reveal the nature of the dataset or the cause of a phenomenon
  • Migrating to the cloud is logical for enterprises planning to run analytics on datasets that are available via data markets, as most data markets store their data in the cloud such as Amazon S3
  • Big Data solutions require a distibuted processing environment that can accomodate large-scale data volumes, velocity and variety

Question 72

Question
Correlated
Answer
  • When two variables are considered to be _____________ they are considered to be aligned based on a linear relationship
  • This means that when one variable changes, the other variable also changes proportionally and constantly
  • items can be ______ either based on a user's own behavior or by matching the behavior of multiple users
  • Note that a workflow engine may provide integration with a _______ to enable the automated import and export data

Question 73

Question
Correlation
Answer
  • is expressed as a decimal number between -1 to +1, which is known as the _____________ coefficient
  • The degree of relationship changes from being strong to weak when moving from -1 to 0 or +1 to 0
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device
  • essentially provides the ability to discover text rather than just search it

Question 74

Question
+1
Answer
  • suggest that there is a strong positive relationship between the two variables
  • When one variable increases, the other also increases and viceversa
  • typically involve large quantities of data with sequential read/writes, and comprises a group of read or write queries
  • Data Extraction

Question 75

Question
0
Answer
  • suggest that there is no relationship at all between the two variables
  • when one increases, the other may stay the same, or increase or decrease arbitrarily
  • it can also be used to make predictions about the values of the dependent variable while it is still unknown
  • Generally, the objective is to gauge human behavior with the goal of increasing sales

Question 76

Question
-1
Answer
  • suggest that there is a strong negative relationship between the two variables
  • when one variable increases, the other decreases and viceversa
  • can be carried out via the use of supported by correlation, heat maps, time series analysis, network analysis, spatial data analysis, clustering, outlier detection, natural language processing and text analytics
  • Therefore, the value of each additional batch does not diminish value; rather, it provides more value

Question 77

Question
Regression
Answer
  • The analysis technique of _________ explores how a dependent variable is related to an independent variable within a dataset
  • As a sample scenario, __________ could help determine the type of relationship that exists between temperature (independent variable) and crop yield (dependent variable)
  • In the context of traditional data analysis, the ______ states that, starting with a reasonably large sample size, the value obtained from the analysis of additional data decreases as more data is successively added to the original sample
  • Data Analysis

Question 78

Question
Regression
Answer
  • Applying this technique helps determine how the value of the dependent variable changes in relation to change in the value of the independent variable
  • When the independent variable increases, for example, does the dependent variable also increase? If yes, is the increase in a linear or non-linear proportion?
  • Business Case Evaluation
  • A _________ comprises grouped read/writes, with a larger data footprint consisting of complex joins and high-latency responses

Question 79

Question
Regression
Answer
  • More than one independent variable can be tested at the same time
  • However, in such cases only one independent variable may change. The others are kept constant
  • The results of completing the _______________ stage provide users with the ability to perform visual analysis, allowing for the discovery of answers to questions that users have not yet even formulated
  • a list of possible third-party data providers (data markets and publicity available datasets), are generally compiled. Some forms of external data may be embedded within blogs or other types of content-based Websites, in which case they may need to be harvested via automated tools

Question 80

Question
Regression
Answer
  • can help enable a better undestanding of what a phenomenon is, and why it occurred
  • it can also be used to make predictions about the values of the dependent variable while it is still unknown
  • Users of Big Data solutions can make numerous data processing requests, each of which can have different processing workload requirements
  • The _____ essencially acts a resource arbitrator that manages and allocates available resources

Question 81

Question
Linear regression
Answer
  • represents a constant rate of change
  • it can be as challenging as combining data mining and complex statistical analysis techniques to discover patterns and anomalies, or to generate a statistical or mathematical model to depict relationship between variables
  • the ______ states that the confidence with which predictions can be made increases as the size of the data that is being analyzed increases
  • Data samples are typically used

Question 82

Question
Non-linear regression
Answer
  • This type of environment is provided by a platform that is comprised of a set of distributed storage and processing technologies
  • Hadoop's batch-based data processing fully lends itself to the pay -per-use model of __________, which can reduce operational costs since a typical Hadoop cluster size can range from a few to a few thousand nodes
  • A ________ is a method of storing and organizing data on a storage medium, such as hard drives, DVD´s, and flash drives
  • represents the variable rate of change

Question 83

Question
Correlation
Answer
  • does not imply a causation. The change in the value of one variable may not be responsible for the change in the value of the second variable, although both may change at the same rate
  • assumes that both variables are independent
  • Within Big Data ________ can first be applied to discover if a relationship exists
  • However, ___________ is always archieved through physically separate machines that are networked together as a cluster

Question 84

Question
Regression
Answer
  • deal with already identified dependent and independent variables
  • implies that there is a degree of causation between the dependent and independent variables that may be direct or indirect
  • can then be applied to further explore the relationship and predict the values of the dependent variable, based on the known values of the independent variables
  • is an example of the application of the law of large numbers

Question 85

Question
Visual Analysis
Answer
  • is a form of data analysis that involves the graphic representation of data to enable or enhance its visual perception
  • based on the premise that humans can understand and draw conclusions from graphics more quickly than from text, _______ act as a discovery tool in the field of Big Data
  • As the amount of digitized documents, e-mails, social media posts and log files increases, business have an increasing need to leverage any value that can be extracted from these forms of semi-structured and unstructured data
  • Is therefore commonly used for data mining where the identification of relationships between variables in a dataset leads to the discovery of patterns and anomalies

Question 86

Question
Visual Analysis
Answer
  • The objective is to use graphic representations to develop a deeper understanding of the data being analyzed. Specifically, it helps identify and highlight hiden patterns, correlations and anomalies
  • is also directly related to exploratory data analysis, as it encourages the formulation of questions from different angles
  • Workflow Engine
  • require processing resources that they request from the resource manager

Question 87

Question
Heat Maps
Answer
  • are an effective visual analysis technique for expressing patterns, data compositions via part-whole relations and geographic distributions of data
  • they also facilitate the identification of areas of interest and the discovery of extreme (high/low) values within a dataset
  • Migrating to the cloud is logical for enterprises planning to run analytics on datasets that are available via data markets, as most data markets store their data in the cloud such as Amazon S3
  • Data analysis results can be used as input for existing _______ or may form the basis of new _______

Question 88

Question
Heat Maps
Answer
  • The ______ itself is a visual, color-coded representation of data values
  • Each value is given a color according to its type, or the range that it falls under
  • Solely analyzing operational (structured) data may cause businesses to miss out on cost-saving or business expansion opportunities, especially those that are customer-focused
  • Applications of __________ include operations and logistic optimization, environmental sciences and infrastructure planning

Question 89

Question
Heat Maps
Answer
  • A ______ can be in the form of a chart or a map
  • Instead of coloring the whole region, the map may be superimposed by a layer made up of collections of colored shapes representing various regions
  • suggestions commonly pertain to recommending items, such as movies, books, web pages, people, etc.
  • Sentiment Analysis

Question 90

Question
chart
Answer
  • A _____ represents a matrix of values in which each cell is color-coded according to the value
  • in order to qualify as a Big Data Problem, a business problem needs to be directly related to one or more of the Big Data characteristics of volume, velocity or variety
  • items can be ______ either based on a user's own behavior or by matching the behavior of multiple users
  • Big data solutions often receive redundant data across different datasets

Question 91

Question
map
Answer
  • A ___ represents a geographic measure by which different regions are color-coded according to a certain theme
  • Although __________ can be implemented in almost any domain, it is most often used in marketing
  • NLP, Text analytics and sentiment analysis be used in support of __________
  • As a sample scenario, __________ could help determine the type of relationship that exists between temperature (independent variable) and crop yield (dependent variable)

Question 92

Question
Heat Maps
Answer
  • Instead of coloring the whole region, the map may be superimposed by a layer made up of collections of colored shapes representing various regions
  • Data needs to be imported before it can be processed by the big data solution
  • The data collected for _______ is always time-dependent
  • Named Entities(person, group, place, company), Pattern-Based Entities(social insurance number, zip code), Concepts (an abstract representation of a entity), Facts (relationship between entities)

Question 93

Question
Time series Analysis
Answer
  • is the analysis of data that is recorded over periodic intervals of time
  • this type of analysis makes use of _________, which is a time-ordered collections of values recorded over regular time intervals
  • in order to qualify as a Big Data Problem, a business problem needs to be directly related to one or more of the Big Data characteristics of volume, velocity or variety
  • data that appears to be invalid may still be valuable in that it may possess hidden patterns and trends

Question 94

Question
Time series Analysis
Answer
  • helps to uncover patterns within data that are time-dependent. Once identified, the pattern can be extrapolated for future predictions.
  • are usually used for forecasting by identifying long-term trends, seasonal periodic patterns and irregular short-term variations in the dataset
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device
  • Big Data solutions can be partially or fully deployed in clouds in order to leverage the storage and computing resources that are available from the cloud provider

Question 95

Question
Time series Analysis
Answer
  • Unlike other types of analyses, _________ always includes time as a comparision variable
  • The data collected for _______ is always time-dependent
  • Data samples are typically used
  • is solely based on the similarity between users' behavior, and requires a large amount of user behavior data in order to accurately filter items

Question 96

Question
Time series Analysis
Answer
  • A _______ is generally expressed using a line chart, with time plotted on the x-axis and recorded data value plotted on the y-axis
  • is the specialized analysis of text through the application of data mining, machine learning and natural language processing techniques to extract value out of unstructured text
  • new models may be used to improve the programming logic within existing enterprise systems or may form the basis of new systems
  • depending on the type of data source, data may come as a dump of files (such as data purchased from a third-party data provider), or may require API integration (such as with Twitter)

Question 97

Question
Network
Answer
  • Within the context of visual analysis, a _______ is a interconnected collection of entities
  • new models may be used to improve the programming logic within existing enterprise systems or may form the basis of new systems
  • this type of analysis makes use of _________, which is a time-ordered collections of values recorded over regular time intervals
  • Consequently, it is important to use the most suitable visualization technique by keeping the business domain in context

Question 98

Question
Entity
Answer
  • An ____ can be a person, a group or some other business domain object such as a product
  • may be connected with another directly or indirectly
  • is a form of data analysis that involves the graphic representation of data to enable or enhance its visual perception
  • Also known as online processing, ____________ processing follows an approach whereby data is processed interactively, without delay (resulting in low-latency responses)

Question 99

Question
Network Analysis
Answer
  • Some connections may only be one-way, so that traversal in the reverse direction is not possible
  • is a technique that focuses on analyzing relationships between entities within the network
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device
  • provides analysis features more sophisticated than those of heat maps

Question 100

Question
Network Analysis
Answer
  • it involves plotting entities as nodes and connections as edges between nodes
  • There are specialized variations of __________ include route optimization, social network analysis and spread prediction
  • Unlike other types of analyses, _________ always includes time as a comparision variable
  • are based on predictive analytics techniques and therefore are associated with the same analysis techniques as predictive analytics. Additionally, _____ may utilize heat maps, network analysis and spatial data analysis to graphically show various outcomes

Question 101

Question
Spatial Data Analysis
Answer
  • focused on analyzing location-based data in order to find different geographic relationship and patterns between entities
  • Spatial or geospatial data is commonly used to identify the geographic location of individual entities
  • in order to qualify as a Big Data Problem, a business problem needs to be directly related to one or more of the Big Data characteristics of volume, velocity or variety
  • The ________ mechanism can also be used for support distributed locks, support distributed queues, establish a highly available registry for obtaining configuration information, reliable asynchronous communication between processes that are running on different servers

Question 102

Question
Spatial Data Analysis
Answer
  • is manipulated through a geographical information system (GIS) that plots spatial data on a map generally using its longitude and latitude coordinates
  • With the ever-increasing availability of location-based data, _________ can be analyzed to gain location insights
  • is dedicated to establishing (often complex) validation rules and removing any known invalid data
  • Correlation

Question 103

Question
Spatial Data Analysis
Answer
  • Applications of __________ include operations and logistic optimization, environmental sciences and infrastructure planning
  • Data used as input for_________ can either contain exact locations (longitude,latitude) or the information required to calculate locations (such as zip codes or IP addresses)
  • the accuracy and applicability of the patterns and relationships that are found in a large dataset will be higher than that of a smaller dataset
  • helps decision-makers understand the business resources that will need to be utilized and which business challenges the analysis will tackle

Question 104

Question
Spatial Data Analysis
Answer
  • provides analysis features more sophisticated than those of heat maps
  • can be used to determine the number of entities that fall within a certain radius of another entity
  • the need to address disparate types of data is more likely with data from external sources
  • is dedicated to establishing (often complex) validation rules and removing any known invalid data

Question 105

Question
Machine Learning
Answer
  • Law of large numbers
  • Law of Diminishing Marginal Utility
  • A target user´s past behavior (likes, rating, purchase history, etc.) is collaborated with the behavior of similar users
  • initial iteration of the big data analysis lifecycle will require more up-front investment of Big Data technologies, products and training compared to later iterations where these earlier investment can be repeatedly leveraged

Question 106

Question
Law of large numbers
Answer
  • the ______ states that the confidence with which predictions can be made increases as the size of the data that is being analyzed increases
  • the accuracy and applicability of the patterns and relationships that are found in a large dataset will be higher than that of a smaller dataset
  • Data Extraction
  • is an analysis technique used to determine whether two variables are related to each other

Question 107

Question
Law of large numbers
Answer
  • this means that the greater the amount of data available for analysis, the better we become at making correct decisions
  • Within computing, a ______ is a tightly coupled collection of servers, or nodes. These servers usually have the same hardware specifications and are connected together via network to work as a single unit
  • Unlike traditional enterprise data where the data structure is pre-defined and data is pre-validated, data input into big data analyses can be unstructured without any indication of validity
  • Classification

Question 108

Question
Law of Diminishing Marginal Utility
Answer
  • In the context of traditional data analysis, the ______ states that, starting with a reasonably large sample size, the value obtained from the analysis of additional data decreases as more data is successively added to the original sample
  • This is a traditional data analysis principle that claims that data held in a reasonably sized dataset provides the maximum value
  • A _______ provides a logical view of the data stored on the storage medium as a tree structure of files and directories
  • this redundancy can be exploited to explore interconnected datasets in order to assemble validation parameters and fill in missing valid data

Question 109

Question
Law of Diminishing Marginal Utility
Answer
  • The ____ does not apply to Big Data
  • The greater the volume and variety of data that Big Data solutions can process allows for each additional batch of data to carry greater potential of unearthing new patterns and anomalies
  • for speech recognition, the system attemps to comprehend the speech and then performs an action, such as transcribing text
  • Applying this technique helps determine how the value of the dependent variable changes in relation to change in the value of the independent variable

Question 110

Question
Law of Diminishing Marginal Utility
Answer
  • Therefore, the value of each additional batch does not diminish value; rather, it provides more value
  • Classification
  • This means that when one variable changes, the other variable also changes proportionally and constantly
  • is an example of the application of the law of large numbers

Question 111

Question
Classification
Answer
  • is a supervised learning technique by which data is classified into relevant, previously learned categories
  • the system is fed data that is already categorized or labeled, so that it can develop an understanding of the different categories
  • therefore, it is advisable to store a verbatim copy of the original dataset before proceeding with the filtering. To save on required storage space, the verbatim copy is compressed before storage
  • Therefore, the value of each additional batch does not diminish value; rather, it provides more value

Question 112

Question
Classification
Answer
  • the system is fed unknown (but similar) data for classification, based on the understanding it developed
  • a common application of this technique is for the filtering of e-mail spam. Note that ___________ can be performed for two or more categories
  • can help enable a better undestanding of what a phenomenon is, and why it occurred
  • it involves plotting entities as nodes and connections as edges between nodes

Question 113

Question
Classification
Answer
  • in a simplified _____ process, the machine is fed labeled data during training that builds its understanding of the _______. The machine is then fed unlabeled data, which is classifies itself
  • also known as split or bucket testing compares two versions of an element to determine which version is superior based on a pre-defined metric
  • A file is an atomic unit of storage used by the _________ to stored data. Files are organizated inside of a directory
  • The objective is to use graphic representations to develop a deeper understanding of the data being analyzed. Specifically, it helps identify and highlight hiden patterns, correlations and anomalies

Question 114

Question
Clustering
Answer
  • is an unsupervised learning technique by which data is divided into different groups so that the data in each group has similar properties
  • There is no prior learning of categories required; intead, categories are implicity generated based on the data groupings
  • Big Data solutions can be partially or fully deployed in clouds in order to leverage the storage and computing resources that are available from the cloud provider
  • Applications include document classification and search, as well as builiding a 360-degree view of a customer by extracting information from a CRM system

Question 115

Question
Clustering
Answer
  • How the data is grouped depends on the type of algorithm used. Each algorithm uses a different technique to identify ______
  • is generally used in data mining to get an understanding of the properties of a given dataset. After developing this understanding, classification can be used to make better predictions about similar, but new or unseen data
  • Is solely dedicated to individual user preferences and does not require data about other users
  • A ______ can be in the form of a chart or a map

Question 116

Question
Clustering
Answer
  • can be applied to the categorization of unknown documents, and to personalized marketing campaings by grouping together customers with similar behavior
  • Within computing, a ______ is a tightly coupled collection of servers, or nodes. These servers usually have the same hardware specifications and are connected together via network to work as a single unit
  • items can be ______ either based on a user's own behavior or by matching the behavior of multiple users
  • the ______ states that the confidence with which predictions can be made increases as the size of the data that is being analyzed increases

Question 117

Question
Outlier Detection
Answer
  • is the process of finding data that is significantly different from or inconsistent with the rest of the data within a given dataset
  • The machine learning technique is used to identify anomalies, abnormalities and desviation that can be advantageous (such as oportunities) or disadvantageous (such a risk)
  • The data collected for _______ is always time-dependent
  • for realtime analytics, a more complex in-memory system is required to validate and cleanse the data at the source

Question 118

Question
Outlier Detection
Answer
  • is closely related to the concept of classificatopm and clustering, although its algorithms focus on finding abnormal values
  • it can be based on either supervised or unsupervised learning
  • involves the simultaneous execution of multiple sub-tasks that collectivelly comprise a larger task
  • it can also be used to infer patterns and relationships within the dataset, such as regression and correlation

Question 119

Question
Outlier Detection
Answer
  • Applications for ___________ include fraud detection, medical diagnosis, network data analysis and sensor data analysis
  • suggest that there is a strong positive relationship between the two variables
  • To the client, a file appears local and can be accessed via multiple locations
  • Heat Maps

Question 120

Question
Filtering
Answer
  • is the automated process of finding relevant items from a pool of items
  • items can be ______ either based on a user's own behavior or by matching the behavior of multiple users
  • The ____ does not apply to Big Data
  • Although __________ can be implemented in almost any domain, it is most often used in marketing

Question 121

Question
Filtering
Answer
  • is generally applied via the following two approaches: collaborative ____________ and content-based ____________
  • A common medium by which ________ is implemented is via the use of a recommender system
  • A given ______ may support either data ingress or egress functions
  • A ________ generally provides only one of the listed functions

Question 122

Question
Colaborative Filtering
Answer
  • is an item filtering technique based on the collaboration (merging) of users' past behavior
  • A target user´s past behavior (likes, rating, purchase history, etc.) is collaborated with the behavior of similar users
  • We may be further interested in discovering how closely Variables A and B are related, which means we may also want to analyze the extend to which Variable B increases in relation to Variable A's increase
  • There are specialized variations of __________ include route optimization, social network analysis and spread prediction

Question 123

Question
Colaborative Filtering
Answer
  • Based on the similarity of the user´s behavior, items are filtered for the target user
  • is solely based on the similarity between users' behavior, and requires a large amount of user behavior data in order to accurately filter items
  • A _____ represents a matrix of values in which each cell is color-coded according to the value
  • The presence of invalid data is resulting in spikes. Although the data appears abnormal, it may be indicative of a new pattern

Question 124

Question
Colaborative Filtering
Answer
  • is an example of the application of the law of large numbers
  • A ______ can be in the form of a chart or a map
  • the system is fed unknown (but similar) data for classification, based on the understanding it developed
  • _____________ is an inductive approach that is closely associated to data mining

Question 125

Question
Content-based Filtering
Answer
  • is an item filtering technique focused on the similarity between users and items
  • A user profile is created based on the user´s past behavior (likes, rating, purchase history, etc.)
  • Analytics Engine
  • can be used to determine the number of entities that fall within a certain radius of another entity

Question 126

Question
Content-based Filtering
Answer
  • The similarities identified between the user profile and the attributes of various items, lead to items being filtered for the user
  • Is solely dedicated to individual user preferences and does not require data about other users
  • Applying this technique helps determine how the value of the dependent variable changes in relation to change in the value of the independent variable
  • However, in such cases only one independent variable may change. The others are kept constant

Question 127

Question
Filtering
Answer
  • A recommender system predicts user preferences and generate suggestions for the user accordingly
  • suggestions commonly pertain to recommending items, such as movies, books, web pages, people, etc.
  • represents a constant rate of change
  • can be carried out via the use of supported by correlation, heat maps, time series analysis, network analysis, spatial data analysis, clustering, outlier detection, natural language processing and text analytics

Question 128

Question
Filtering
Answer
  • A recommender system typically uses either colaborative _____ or content-based _________ to generate suggestions
  • Recommender systems may also be based on a hybrid of both collaborative _______ and content-based _______ to fine-tune the accuracy and effectiveness of generated suggestions
  • Classification, outlier detection, filtering, natural language processing, text analytics and sentiment analysis can utilize ___________
  • Data analysis results can be used as input for existing _______ or may form the basis of new _______

Question 129

Question
Semantic Analysis
Answer
  • In order for the machines to extract valuable information, text and speech data needs to be understood by the machines in the same way as humans do. _____ represents practices for extracting meaningful information from textual and speech data
  • require processing resources that they request from the resource manager
  • The same results may be presented in a number of different ways, which can influence the interpretation of the results
  • Instead, the data is explored through analysis to develop an understanding of the cause of the phenomenon

Question 130

Question
Natural Language Processing
Answer
  • is a computer's ability to comprehend human speech and text as naturally understood by humans
  • this allows computers to perform a variety of useful task, such as full-text searches
  • A _______ database generally provides an API-based query interface, rather than the SQL Interface
  • Each node in the _____ has its own dedicated resources such as memory and hard drive and runs its own operating system just like a desktop computer

Question 131

Question
Natural Language Processing
Answer
  • Instead of hard-coding the required learning rules, either supervised or unsupervised machine learning is applied to develop the computer's understanding of the __________
  • In general, the more learning data the computer has, the more correctly it can decipher human text and speech
  • A distributed Big Data solution that needs to run on multiple servers relies on the coordination engine mechanism to ensure operational consistency across all of the participating servers
  • functionally can be further grouped into the following categories: event, file, relational

Question 132

Question
Natural Language Processing
Answer
  • includes both text and speech recognition
  • for speech recognition, the system attemps to comprehend the speech and then performs an action, such as transcribing text
  • A user profile is created based on the user´s past behavior (likes, rating, purchase history, etc.)
  • The processing engine enables data to be queried and manipulated in other ways, but to implement this type of functionality requires custom programming

Question 133

Question
Text Analytics
Answer
  • Unstructured text is generally much more difficult to analyze and search, compared to structured text
  • is the specialized analysis of text through the application of data mining, machine learning and natural language processing techniques to extract value out of unstructured text
  • As the amount of digitized documents, e-mails, social media posts and log files increases, business have an increasing need to leverage any value that can be extracted from these forms of semi-structured and unstructured data
  • Useful insights from text-based data can be gained by helping businesses develop an understanding of the information that is contained within a large body of text

Question 134

Question
Text Analytics
Answer
  • essentially provides the ability to discover text rather than just search it
  • The basic tenet of ___________ is to turn unstructured text into data that can be searched and analyzed
  • Analysts working with big data solutions are not expected to know how to program processing engines
  • comprise random read/writes that involve fewer joins and require low-latency responses, with a smaller data footprint

Question 135

Question
Text Analytics
Answer
  • Solely analyzing operational (structured) data may cause businesses to miss out on cost-saving or business expansion opportunities, especially those that are customer-focused
  • Applications include document classification and search, as well as builiding a 360-degree view of a customer by extracting information from a CRM system
  • However, in such cases only one independent variable may change. The others are kept constant
  • is a form of data analysis that involves the graphic representation of data to enable or enhance its visual perception

Question 136

Question
Text Analytics
Answer
  • generally involves two steps: Parsing text within documents to extract, Categorization of documents using these extracted entities and facts
  • the extracted information can be used to perform a context-specific search on entities, based on the type of relationship that exists between the entities
  • identifying a wider variety of data sources may increase the probability of finding hidden patterns and correlations
  • Similarly, processed data may need to be exported to other systems before it can be used outside of the big data solution

Question 137

Question
Parsing text within documents to extract:
Answer
  • Named Entities(person, group, place, company), Pattern-Based Entities(social insurance number, zip code), Concepts (an abstract representation of a entity), Facts (relationship between entities)
  • Data Extraction
  • is generally used in data mining to get an understanding of the properties of a given dataset. After developing this understanding, classification can be used to make better predictions about similar, but new or unseen data
  • The ________ mechanisms is responsible for processing data (usually retrieved from storage devices) based on pre-defined logic, in order to produce a result

Question 138

Question
Sentiment Analysis
Answer
  • is a specialized form of text analysis that focuses on determining the bias or emotions of individuals
  • this form of analysis determines the attitude of the author (of the text) by analyzing the text within the context of the natural language
  • The proposed cause or assumption is called a ____________
  • In other areas such as the scientific domains, the objective may simply be to observe which version works better in order to improve a process or product

Question 139

Question
Sentiment Analysis
Answer
  • not only provides information about how individuals feel, but also the intensity of their feeling
  • this information can then be integrated into the decision-making process
  • Machine Learning
  • Instead, the data is explored through analysis to develop an understanding of the cause of the phenomenon

Question 140

Question
Sentiment Analysis
Answer
  • Common applications for __________ include early identification of customer satisfaction or dissatisfaction, gauging product sucess or failure and spotting new trends
  • Utilization of Analysis Results
  • Generally, the objective is to gauge human behavior with the goal of increasing sales
  • are usually divided into two types: Batch and Transactional

Question 141

Question
Quantitative Analysis
Answer
  • Correlation and regression are examples of ________. A/B testing can make use of ____________ techniques for results comparision.
  • Unstructured text is generally much more difficult to analyze and search, compared to structured text
  • Storage Device
  • Clustering

Question 142

Question
Qualitative Analysis
Answer
  • NLP, Text analytics and sentiment analysis be used in support of __________
  • Machine Learning
  • To the client, a file appears local and can be accessed via multiple locations
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device

Question 143

Question
Data Mining
Answer
  • can be carried out via the use of supported by correlation, heat maps, time series analysis, network analysis, spatial data analysis, clustering, outlier detection, natural language processing and text analytics
  • this stage can be iterative in nature, especially if the _________________ is exploratory so that analysis is repeated until the appropiate pattern or correlation is uncovered
  • An ________ is employed when the comparatively simple data manipulation functions of a query engine are insufficient
  • metadata is added through an automated mechanism to data received from both internal and external data sources

Question 144

Question
Descriptive Analytics
Answer
  • A/B testing, heat maps and spatial data analysis are considered forms of ____________
  • There are specialized variations of __________ include route optimization, social network analysis and spread prediction
  • The output of one workflow can become the input of another workflow
  • Strategic BI and analytics fall in this category, since they are highly read intensive task involving large volumes of data

Question 145

Question
Diagnostic Analytics
Answer
  • Correlation, regression, time series analysis, network analysis and spatial data analysis are considered forms of _________
  • The workflow logic processed by a _____________ mechanism can involve the participation of other big data mechanism
  • The ________ mechanisms is responsible for processing data (usually retrieved from storage devices) based on pre-defined logic, in order to produce a result
  • in order to qualify as a Big Data Problem, a business problem needs to be directly related to one or more of the Big Data characteristics of volume, velocity or variety

Question 146

Question
Predictive Analysis
Answer
  • Correlation, regression, time series analysis, classification, clustering, outlier detection, filtering, natural language processing, text analytics and sentiment analysis are considered forms of ________
  • is an unsupervised learning technique by which data is divided into different groups so that the data in each group has similar properties
  • Named Entities(person, group, place, company), Pattern-Based Entities(social insurance number, zip code), Concepts (an abstract representation of a entity), Facts (relationship between entities)
  • provenance can play an important role in determining the accuracy and quality of qustionable data

Question 147

Question
Prescriptive Analytics
Answer
  • are based on predictive analytics techniques and therefore are associated with the same analysis techniques as predictive analytics. Additionally, _____ may utilize heat maps, network analysis and spatial data analysis to graphically show various outcomes
  • Applying this technique helps determine how the value of the dependent variable changes in relation to change in the value of the independent variable
  • This can reveal the nature of the dataset or the cause of a phenomenon
  • Time series analysis

Question 148

Question
Supervised Learning
Answer
  • Classification, outlier detection, filtering, natural language processing, text analytics and sentiment analysis can utilize ___________
  • A big data _________ utilizes a distributed parallel programming framework that enables it to process very large amounts of data distributed across multiple nodes
  • uses statistical methods based on mathematical formulas as a means for analyzing data
  • A user profile is created based on the user´s past behavior (likes, rating, purchase history, etc.)

Question 149

Question
Unsupervised Learning
Answer
  • Clustering, outlier detection, filtering, natural language processing, text analytics and sentiment analysis can utilize ___________
  • Data analysis results can be used as input for existing _______ or may form the basis of new _______
  • A _____ represents a matrix of values in which each cell is color-coded according to the value
  • Models can be used to improve business process logic, application system logic and can form the basis of a new system or software program

Question 150

Question
Cluster
Answer
  • Within computing, a ______ is a tightly coupled collection of servers, or nodes. These servers usually have the same hardware specifications and are connected together via network to work as a single unit
  • Each node in the _____ has its own dedicated resources such as memory and hard drive and runs its own operating system just like a desktop computer
  • These engines may provide the agent-based processing of inflight data, which enables various data cleasing and transformation activities to be performed in realtime
  • Unexpected findings or anomalies are usually ignored since a predetermined cause was assumed

Question 151

Question
Cluster
Answer
  • In the diagram, a _____ is used to execute a task based on distributed / parallel data processing frameworks
  • A/B Testing
  • Big Data solutions require a distibuted processing environment that can accomodate large-scale data volumes, velocity and variety
  • Migrating to the cloud is logical for enterprises planning to run analytics on datasets that are available via data markets, as most data markets store their data in the cloud such as Amazon S3

Question 152

Question
File System
Answer
  • A ________ is a method of storing and organizing data on a storage medium, such as hard drives, DVD´s, and flash drives
  • A file is an atomic unit of storage used by the _________ to stored data. Files are organizated inside of a directory
  • This can reveal the nature of the dataset or the cause of a phenomenon
  • The proposed cause or assumption is called a ____________

Question 153

Question
File System
Answer
  • A _______ provides a logical view of the data stored on the storage medium as a tree structure of files and directories
  • Operating systems employ ______ for data storage. Each operating system provides support for one or more ________, like NTFS for windows and ext for linux
  • this form of analysis determines the attitude of the author (of the text) by analyzing the text within the context of the natural language
  • Within Big Data ________ can first be applied to discover if a relationship exists

Question 154

Question
Distributed File System
Answer
  • A _________ is a file system that can store large files spread across a cluster
  • To the client, a file appears local and can be accessed via multiple locations
  • is the process of finding data that is significantly different from or inconsistent with the rest of the data within a given dataset
  • Natural Language Processing

Question 155

Question
Distributed File System
Answer
  • Examples include the Google File System and Hadoop ________
  • requires that a business case be created, assessed and approved prior to proceeding with the actual hands-on analysis task
  • Machine Learning
  • Data Aggregation & Representation

Question 156

Question
NoSQL
Answer
  • A _______ database is a non-relational database that is highly scalable, fault-tolerant and specifically designed to house unstructured data
  • A _______ database generally provides an API-based query interface, rather than the SQL Interface
  • The use of ________ helps to develop and understanding of a dataset and find relationships that can assist in explaining a phenomenon
  • when one increases, the other may stay the same, or increase or decrease arbitrarily

Question 157

Question
NoSQL
Answer
  • However, some _______ databases may also provide a SQL-like query interface
  • this allows computers to perform a variety of useful task, such as full-text searches
  • depending on the type of analytics required, this stage can be as simple as querying a dataset to compute an aggregation for comparision
  • processing engine, storage device, resource manager

Question 158

Question
Parallel Data Processing
Answer
  • involves the simultaneous execution of multiple sub-tasks that collectivelly comprise a larger task
  • the premise is to reduce the execution time by dividing a single larger task into multiple smaller task
  • A _________ in Big Data os defined as the amount and nature of data that is processed within a certain amount of time
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device

Question 159

Question
Parallel Data Processing
Answer
  • Although __________ can be archieved through multiple networked machines, it is more typically achieved within the confines of a single machine (multiple processors or cores)
  • the system is fed data that is already categorized or labeled, so that it can develop an understanding of the different categories
  • Law of Diminishing Marginal Utility
  • provides analysis features more sophisticated than those of heat maps

Question 160

Question
Distributed Data Processing
Answer
  • is closely related to parallel data processing in how the same principle of "divide-and-conquer" is applied
  • However, ___________ is always archieved through physically separate machines that are networked together as a cluster
  • essentially provides the ability to discover text rather than just search it
  • This allows large amounts of data to be imported or exported within a short period of time

Question 161

Question
Processing workloads
Answer
  • A _________ in Big Data os defined as the amount and nature of data that is processed within a certain amount of time
  • are usually divided into two types: Batch and Transactional
  • includes both text and speech recognition
  • A distributed Big Data solution that needs to run on multiple servers relies on the coordination engine mechanism to ensure operational consistency across all of the participating servers

Question 162

Question
Batch Workload
Answer
  • Also known as offline processing, ________ processing involves processing data in batches and usually imposes delays (resulting in high-latency responses)
  • typically involve large quantities of data with sequential read/writes, and comprises a group of read or write queries
  • also known as split or bucket testing compares two versions of an element to determine which version is superior based on a pre-defined metric
  • An ____ can be a person, a group or some other business domain object such as a product

Question 163

Question
Batch Workload
Answer
  • Queries can be complex and involve multiple joins
  • Strategic BI and analytics fall in this category, since they are highly read intensive task involving large volumes of data
  • Sentiment Analysis
  • NLP, Text analytics and sentiment analysis be used in support of __________

Question 164

Question
Batch Workload
Answer
  • A _________ comprises grouped read/writes, with a larger data footprint consisting of complex joins and high-latency responses
  • Spatial Data Analysis
  • Correlation, regression, time series analysis, network analysis and spatial data analysis are considered forms of _________
  • Users of Big Data solutions can make numerous data processing requests, each of which can have different processing workload requirements

Question 165

Question
Transactional workload
Answer
  • Also known as online processing, ____________ processing follows an approach whereby data is processed interactively, without delay (resulting in low-latency responses)
  • involves small amounts of data with random read/writes
  • Data Validation & Cleansing
  • A/B Testing

Question 166

Question
Transactional workload
Answer
  • OLTP and operational systems (write-intensive) as well as operational BI and analytics (read-intensive), both fall within this category
  • Although these workloads contain a mix of read/write queries, they are generally more write-intensive than read-intensive
  • can act as a common denominator that can be used for a range of analysis techniques and projects. This can require establishing a central, standard analysis repository, such as a NoSQL database
  • comprise random read/writes that involve fewer joins and require low-latency responses, with a smaller data footprint

Question 167

Question
Cloud Computing
Answer
  • is a specialized form of distibuted computing that introduce utilization models for remotely provisioning scalable and measured IT resources
  • Big Data solutions can be partially or fully deployed in clouds in order to leverage the storage and computing resources that are available from the cloud provider
  • Data samples are typically used
  • It can also represent hierarchical values by using color-coded nested rectangles

Question 168

Question
Cloud Computing
Answer
  • the clustered processing resources required by Big Data solutions can benefit from the highly scalable and elastic IT resources available on cloud-based environments
  • Hadoop's batch-based data processing fully lends itself to the pay -per-use model of __________, which can reduce operational costs since a typical Hadoop cluster size can range from a few to a few thousand nodes
  • is generally applied via the following two approaches: collaborative ____________ and content-based ____________
  • In short _______ provides the three ingredients required for a big data solutions: input data, computing and storage

Question 169

Question
It makes sence from enterprises already using cloud computing to reuse the cloud from their Big Data initiatives, because:
Answer
  • IT already possesses the required cloud computing skills
  • the imput data already exists in the cloud
  • Correlation, regression, time series analysis, network analysis and spatial data analysis are considered forms of _________
  • In the context of traditional data analysis, the ______ states that, starting with a reasonably large sample size, the value obtained from the analysis of additional data decreases as more data is successively added to the original sample

Question 170

Question
Cloud Computing
Answer
  • Migrating to the cloud is logical for enterprises planning to run analytics on datasets that are available via data markets, as most data markets store their data in the cloud such as Amazon S3
  • Workflow Engine
  • not only provides information about how individuals feel, but also the intensity of their feeling
  • This can reveal the nature of the dataset or the cause of a phenomenon

Question 171

Question
Big data Mechanisms
Answer
  • Big Data solutions require a distibuted processing environment that can accomodate large-scale data volumes, velocity and variety
  • This type of environment is provided by a platform that is comprised of a set of distributed storage and processing technologies
  • it can be beneficial to identify as many types of related data sources and insights as possible, especially when we dont know exactly what we're looking for
  • Is solely dedicated to individual user preferences and does not require data about other users

Question 172

Question
Big data Mechanisms
Answer
  • represents the primary, common components of big data solutions, regardless of the open source or vendor products used for implementation
  • Storage Device
  • Instead of coloring the whole region, the map may be superimposed by a layer made up of collections of colored shapes representing various regions
  • Query Engine

Question 173

Question
Big data Mechanisms
Answer
  • Processing Engine
  • Resource Manager
  • Applications of __________ include operations and logistic optimization, environmental sciences and infrastructure planning
  • is generally used in data mining to get an understanding of the properties of a given dataset. After developing this understanding, classification can be used to make better predictions about similar, but new or unseen data

Question 174

Question
Big data Mechanisms
Answer
  • Data Transfer Engine
  • Analytics Engine
  • is closely related to parallel data processing in how the same principle of "divide-and-conquer" is applied
  • The data collected for _______ is always time-dependent

Question 175

Question
Big data Mechanisms
Answer
  • Workflow Engine
  • Coordination Engine
  • Recommender systems may also be based on a hybrid of both collaborative _______ and content-based _______ to fine-tune the accuracy and effectiveness of generated suggestions
  • There is no prior learning of categories required; intead, categories are implicity generated based on the data groupings

Question 176

Question
At minimun, any given big data solution needs to contain the _____, ______ and _______ mechanism in order to effectively process large datasets in support of the big data analysis lifecycle
Answer
  • processing engine, storage device, resource manager
  • storage device, analytics engine, coordination engine
  • processing engine , query engine, data transfer engine
  • resource manager, analytics engine, workflow engine

Question 177

Question
Storage Device
Answer
  • ___________ mechanisms provide the underlying data storage environment for persisting the datasets that are processed by big data solutions
  • A ________ is a method of storing and organizing data on a storage medium, such as hard drives, DVD´s, and flash drives
  • A _______ can exists as a distibuted file system or a database
  • The ability to analyze massive amounts of data and find useful insights carries little value if the only ones that can interpret the results are the analysis

Question 178

Question
Storage Device
Answer
  • Distributed file systems can be used for persisting immutable data that is intended for streaming access or batch processing
  • Databases, such as NoSQL repositories, can be used for structured and unstructured storage and read/write data access
  • Note that distributed file systems and databases are both on disk _________ mechanisms
  • Natural Language Processing

Question 179

Question
Processing Engine
Answer
  • The ________ mechanisms is responsible for processing data (usually retrieved from storage devices) based on pre-defined logic, in order to produce a result
  • Any data processing that is requested by the big data solution is fulfilled by the __________
  • Whether _____________ is required or not, it is important to understand that the same data can be stored in many different forms. One form may be better suited for a particular type of analysis than another
  • Hadoop's batch-based data processing fully lends itself to the pay -per-use model of __________, which can reduce operational costs since a typical Hadoop cluster size can range from a few to a few thousand nodes

Question 180

Question
Processing Engine
Answer
  • A big data _________ utilizes a distributed parallel programming framework that enables it to process very large amounts of data distributed across multiple nodes
  • require processing resources that they request from the resource manager
  • Classification
  • are usually used for forecasting by identifying long-term trends, seasonal periodic patterns and irregular short-term variations in the dataset

Question 181

Question
Batch Processing Engine
Answer
  • Provides support for batch data where processing tasks can take anywhere from minutes to hours to complete. This type of processing engine is considered to have high latency
  • The identified patterns, correlations and anormalies discovered during the data analysis are used to refine business processes
  • When one variable increases, the other also increases and viceversa
  • Operating systems employ ______ for data storage. Each operating system provides support for one or more ________, like NTFS for windows and ext for linux

Question 182

Question
Realtime Processing Engine
Answer
  • Provides support for realtime data with sub-seconds response times. This type of processing engine is considered to have low latency
  • To the client, a file appears local and can be accessed via multiple locations
  • Migrating to the cloud is logical for enterprises planning to run analytics on datasets that are available via data markets, as most data markets store their data in the cloud such as Amazon S3
  • depending on the type of data source, data may come as a dump of files (such as data purchased from a third-party data provider), or may require API integration (such as with Twitter)

Question 183

Question
Resource Manager
Answer
  • Users of Big Data solutions can make numerous data processing requests, each of which can have different processing workload requirements
  • Data that is held in storage can be processed in a variety of ways by a given Big Data solutions and all data processing requests require the allocation of processing resources
  • it involves plotting entities as nodes and connections as edges between nodes
  • the system is fed data that is already categorized or labeled, so that it can develop an understanding of the different categories

Question 184

Question
Resource Manager
Answer
  • A _______ acts as a schedules and prioritizes processing requests according to individual processing workload requirements
  • The _____ essencially acts a resource arbitrator that manages and allocates available resources
  • A value that is labelled differently in two different datasets may mean the same thing
  • The proposed cause or assumption is called a ____________

Question 185

Question
Data Transfer Engine
Answer
  • Data needs to be imported before it can be processed by the big data solution
  • Similarly, processed data may need to be exported to other systems before it can be used outside of the big data solution
  • this form of analysis determines the attitude of the author (of the text) by analyzing the text within the context of the natural language
  • Text Analytics

Question 186

Question
Data Transfer Engine
Answer
  • A ________ engine enables data to be moved in or out big data solution storage devices
  • Unlike other data processing systems where input data conforms to a schema and is mostly structured, data sources for a big data solution tend to include a mix of structured and unstructured data
  • is dedicated to determining how and where processed analysis data can be further leveraged
  • A given ______ may support either data ingress or egress functions

Question 187

Question
Data Transfer ingress and egress
Answer
  • functionally can be further grouped into the following categories: event, file, relational
  • the processing engine mechanism will often use the ___________ to coordinate data processing across a large number of servers. This way, the processing engine does not require its own coordination logic
  • can help enable a better undestanding of what a phenomenon is, and why it occurred
  • therefore, it is advisable to store a verbatim copy of the original dataset before proceeding with the filtering. To save on required storage space, the verbatim copy is compressed before storage

Question 188

Question
Data Transfer Engine
Answer
  • A ________ generally provides only one of the listed functions
  • It is common for multiple diferent ________ to be part a big data solution to facilitate a range of import and export requirements for different types of data
  • A _______ provides a logical view of the data stored on the storage medium as a tree structure of files and directories
  • are based on predictive analytics techniques and therefore are associated with the same analysis techniques as predictive analytics. Additionally, _____ may utilize heat maps, network analysis and spatial data analysis to graphically show various outcomes

Question 189

Question
Data Transfer Ingress Engine
Answer
  • Event-based __________ generally use a publish-subcribe model based on the use of a queue to ensure high reliability and availability
  • A file is an atomic unit of storage used by the _________ to stored data. Files are organizated inside of a directory
  • it can be based on either supervised or unsupervised learning
  • The data collected for _______ is always time-dependent

Question 190

Question
Data Transfer Engine
Answer
  • These engines may provide the agent-based processing of inflight data, which enables various data cleasing and transformation activities to be performed in realtime
  • enable the substitution of data that is distributed across a range of sources residing in multiple systems outside of the big data solution
  • Heat Maps
  • is manipulated through a geographical information system (GIS) that plots spatial data on a map generally using its longitude and latitude coordinates

Question 191

Question
Data Transfer Engine
Answer
  • A _______ may internally use a processing engine to process multiple large datasets in parallel
  • This allows large amounts of data to be imported or exported within a short period of time
  • Note that a workflow engine may provide integration with a _______ to enable the automated import and export data
  • is a computer's ability to comprehend human speech and text as naturally understood by humans

Question 192

Question
Query Engine
Answer
  • The processing engine enables data to be queried and manipulated in other ways, but to implement this type of functionality requires custom programming
  • Analysts working with big data solutions are not expected to know how to program processing engines
  • this form of analysis determines the attitude of the author (of the text) by analyzing the text within the context of the natural language
  • the extracted information can be used to perform a context-specific search on entities, based on the type of relationship that exists between the entities

Question 193

Question
Query Engine
Answer
  • The _______ mechanism abstracts the processing engine from end-users by providing a front-end user-interface that can used to query underlying data, along with features for creating query execution plans
  • Languages that are more familiar and easier to work with (such as SQL) can be used by non-technical users to perform ETL tasks and run ad hoc queries for data analysis activities
  • this helps maintain data provenance throughout the big data analysis lifecycle, which helps establish and preserve data accuracy and quality
  • Either way, a method of data reconciliation is required or the dataset representing the correct value needs to be determined

Question 194

Question
Query Engine
Answer
  • Common processing functions performed by a ______ include sum,average, group by join and sort
  • Under the hood, the ________ seamlessly transforms user queries into the relevant low-level code that can be used by the processing engine
  • The use of ________ can reduce development time and enables the manipulation of large datasets without the need to write complex programming logic
  • based on the business requirements documented, it can be determined whether the business problems being addressed are really Big Data problems

Question 195

Question
Analytics Engine
Answer
  • The ________ mechanism is able to process advanced statistical and machine learning algorithms in support of analytics processing requirements, including the identification of patterns and correlations
  • It generally uses the processing engine mechanism to run algorithms on large datasets.
  • A _______ database generally provides an API-based query interface, rather than the SQL Interface
  • A ________ generally provides only one of the listed functions

Question 196

Question
Analytics Engine
Answer
  • An ________ is employed when the comparatively simple data manipulation functions of a query engine are insufficient
  • Some propietary ________ also provide specialized data analysis features, such as text analytics and machine log analysis processing
  • How the data is grouped depends on the type of algorithm used. Each algorithm uses a different technique to identify ______
  • This is a traditional data analysis principle that claims that data held in a reasonably sized dataset provides the maximum value

Question 197

Question
Workflow Engine
Answer
  • A ___________ provides the ability to design and process a complex sequence of operations that can be triggered either at set time intervals or when data becomes available
  • The workflow logic processed by a _____________ mechanism can involve the participation of other big data mechanism
  • Strategic BI and analytics fall in this category, since they are highly read intensive task involving large volumes of data
  • Law of large numbers

Question 198

Question
Workflow Engine
Answer
  • For example, a __________ can execute logic that collects relational data from multiple databases at regular intervals via the data transfer engine mechanism, applies a set of ETL operations via the processing engine mechanism and finally persists the results to a NoSQL storage device
  • The defined workflows are analogous to a flowchart with control logic (such as decisions, forks, joins) and generally rely on a batch-style processing engine for execution
  • The output of one workflow can become the input of another workflow
  • it can be based on either supervised or unsupervised learning

Question 199

Question
Coordination Engine
Answer
  • A distributed Big Data solution that needs to run on multiple servers relies on the coordination engine mechanism to ensure operational consistency across all of the participating servers
  • make it possible to develop highly reliable, highly available distributed big data solutions that can be deployed in a cluster
  • A model look like a mathematical equation or a set of rules
  • data that appears to be invalid may still be valuable in that it may possess hidden patterns and trends

Question 200

Question
Coordination Engine
Answer
  • the processing engine mechanism will often use the ___________ to coordinate data processing across a large number of servers. This way, the processing engine does not require its own coordination logic
  • The ________ mechanism can also be used for support distributed locks, support distributed queues, establish a highly available registry for obtaining configuration information, reliable asynchronous communication between processes that are running on different servers
  • in the case of realtime analytics, the data is analyzed first and then persisted to disk
  • Big Data solutions require a distibuted processing environment that can accomodate large-scale data volumes, velocity and variety
Show full summary Hide full summary

Similar

FUNDAMENTOS DE REDES DE COMPUTADORAS
anhita
Test: "La computadora y sus partes"
Dayana Quiros R
Abreviaciones comunes en programación web
Diego Santos
Seguridad en la red
Diego Santos
Excel Básico-Intermedio
Diego Santos
Evolución de la Informática
Diego Santos
Introducción a la Ingeniería de Software
David Pacheco Ji
Conceptos básicos de redes
ARISAI DARIO BARRAGAN LOPEZ
La ingenieria de requerimientos
Sergio Abdiel He
TECNOLOGÍA TAREA
Denisse Alcalá P
Navegadores de Internet
M Siller