Flashcards
Big Data
Cards in this deck (6)
- 1Define big dataKnow that 'Big Data' is a catch-all term for data that won't fit the usual containers.
- 2Big Data can be described in terms of:• volume - too big to fit into a single server
• velocity - streaming data, milliseconds to seconds to respond
• variety - data in many forms such as structured, unstructured, text, multimedia - 3Elaborate on previous flashcardThe most difficult aspect of Big Data really involves its lack of structure. This lack of structure poses challenges because:
• analysing the data is made significantly more difficult
• relational databases are not appropriate because they require the data to fit into a row-and-column format.
Machine learning techniques are needed to discern patterns in the data and to extract useful information.
'Big' is a relative term, but size impacts when the data doesn’t fit onto a single server because relational databases don’t scale well across multiple machines.
Data from networked sensors, smartphones, video surveillance, mouse clicks etc are continuously streamed. - 4When data sizes are so big as not to fit on to a single server:The processing must be distributed across more than one machine
Functional programming is a solution, because it makes it easier to write correct and efficient distributed code. - 5Know what features of functional programming make it easier to write: correct code code that can be distributed to run across more than one server.Functional programming languages support:
Immutable data structures + Statelessness (No side effects, calling a function cannot alter the states)
Higher-order functions (Easier to see which parts of the code are independent => arrange code to run in parallel => scale hardware horizontally) - 6—
Information
- Description
- A level Computing Flashcards on Big Data, created by Mr Wiggly Gamer A.C on 30/05/2023.
- Created by
- Mr Wiggly Gamer A.C
- Views
- 6
- Rating