Flashcards
1. Flash cards
Cards in this deck (46)
- 1dataA collection of values that represent some things in the real world (or imaginary worlds).
- 2datasetA collection of data elements on a topic or theme, usually with some underlying organisational structure.
- 3data viewThe subset of data resulting from a query or retrieval, filtering and manipulation operations applied to a dataset.
- 4MetadataMetadata is data about data data about a particular data item, dataset or data view, e.g. how big it is, who collected it, etc. It can also apply to the datas analysis and management, for example when a database was last archived.
- 5data management(a) The collection of activities related to the delivery and support of an organisations information life cycle.
(b) The control of information generated during a research project. - 6data analysisThe examination and manipulation of data with the aim of generating and discovering additional information, and supporting decision-making processes.
- 7integrityThe completeness, correctness and coherence of a dataset or a data structure and the values stored within it.
- 8interpretation (of raw data)Finding meaning in (raw) data items.
- 9Kitchen's 5 characteristics of dataForm - Quantitative or qualitative
Structure - either structured semi structure or unstructured
Source - Captured, Exhaust, Original or derived, transient.
Type - Indexical, Attribute, Metadata - 10The 3 v'sVolume : our traditional measure of data size how much there is of it.
Variety : in many different, sometimes incompatible forms and representations.
Velocity : how fast new data is generated and has to be processed. - 116 v's(volume, variety and velocity)
Veracity : the quality of the data; how clean it is.
Validity : to what extent the facts the data incorporates are correct and consistent for their context (an incorrect answer to a question may not be true, but may be a correct data element if you are handling replies to quiz questions).
Volatility : how quickly data changes, or becomes invalid. - 12step changeA small change in some underlying dimension that results in the need for a new way of handling the subject under focus. For example: Moving from a personal to a corporate level of data management requires a step change in security.
- 13data handlingThe collection of activities related to the capture, recording and presentation of data.
- 14The data cyclehttps://s3.amazonaws.com/classconnection/291/flashcards/2759291/jpg/the_data_cycle-156FF426B9608EA1D1A.jpg
- 15Name 5 issues in data managementlegal
control
curation
flexibility
currency and maintenance. - 16What are the 7 principles of the data1. fair and lawful
2. purposes
3. adequacy
4. accuracy
5. retention
6. rights
7. security and international - 17What are the rights as laid out in the data protection act 1998- a right of access to a copy of the information
- object to processing that causes damage or distress;
- prevent processing for direct marketing;
- object to decisions being taken by automated means;
- to have inaccurate pd rectified, blocked, erased or destroyed;
- claim compensation for damages caused by a breach of the Act. - 18curationThe long-term management of historical items (including data) so that they can remain accessible and usable.e long-term management of historical items (including data) so that they can remain accessible and usable.
- 19database schemaA (formal) description of the structure of the logical view of an entire db. It defines how data is organised and how relationships are represented. It describes constraints applied to the data, and can include aspects of ownership and security. A formal description is maintained by a DBMS to ensure valid data is held, and safely processed with the DBMS. Schemas are often also created to described user view and a physical view of the db. The logical and physical schema are then related by a mapping between them.
- 20currencyThe currency, or timeliness, of data recognises that datasets can become obsolete or unfit for purpose either because the reality that the data elements represent are no longer valid (e.g. a cars recorded owner is not updated after a car is sold) or the data element no longer fulfils the purpose for which it was generated (timeliness).
- 21CRUDCreate, Read, Update, Delete
- 22name three main data management architectures* online transaction processing (OLTP) systems
* online analytical processing (OLAP) systems
* data stream processing (DSP) systems. - 23online transaction processing (OLTP)A model of data processing that maintains a consistent body of data against a series of (sometimes complex) transactions in a way that ensures that the transactions appear to be applied independently of other transactions in the system. Applying a transaction moves the dataset from one consistent state to another.
- 24online analytical processing (OLAP)A model of processing in which settled historical data is collected, cleaned and structured for analysis purposes.
- 25data stream processing (DSP)A model of processing data that supports a continuous stream of (fast) newly arriving data that is handled on the fly, in some cases without long-term storage of the data elements.
- 26data dredgingDerogatory version of data mining mining is seen to be selective or discriminating, dredging has an indiscriminate connotation.
- 27data miningAutomated searching through (large) data collections for specific facts or information, or to uncover new patterns or trends in the data.
- 28Name 8 attributes of data qualityAccuracy, Validity, Reliability, Timeliness, Relevance, Consistency, Completeness, and Provenance.
- 29bias(a) A systematic distortion of a statistical result due to a factor not allowed for in its derivation.
(b) Evidence or argument supporting or opposing a thing in which the evidence has been incorrectly collected or interpreted or the argument structured in an unfair way. - 30How do data scientist classify the scale of data.
- 31What is the difference between a development process and a process model or life cycle?A development process is the set of rules that defines how a software development project should be carried out. The order in which these are carries out is the process model or life cycle
- 32What should the role of project manager be with respect to the deliverable of a development project?Project management involves the identification of appropriate deliverables given a set of requirements and controlling the cost of producing them. it also ensures that they are delivered on time.
- 33The manifesto for Agile development
- 34what is added to a development process with the introduction of risk management?There are 4 steps that are repeated with each iteration of the spiral.
1 - determine the objectives
2 - evaluate the objectives
3 - develop a solution
4 - review that solution - 35Why is traceability important to the development of softwareIt is important for the reconstruction of significant events. You should be able to trace backwards from an implemented component through their design to a given requirement.
- 36How would you characterize agile documentationAgile documentation should be collected with a purpose, be easy to use and should justify the effort
- 37Data preparation involves two activities:removing or repairing obvious errors and inconsistencies in the dataset, often known as data cleansing
combining and shaping datasets, often known as data integration and data transformation. - 38modellingA way of thinking about things and ideas in the real world. A model is a way of expressing a particular view of an identifiable system.
- 39how are models helpful?1. A way of understanding the problems
2. An aid to communication
3. A component of the processes used in development activities ie analysis and design. - 40What should you look for when choosing a modelling language?sufficiently expressive
easy to learn and use
unambiguous
widely used
supported by suitable tools. - 41Unified Modeling Language (UML)A language for visualising, specifying, constructing and documenting the artefacts of a software-intensive system.
- 42What are the two kinds of rule that govern the use of a modelling language?A modelling language is normally diagrammatic, although it can be textual rules determine:
1. Whether or not a diagram is legal – the syntax of a diagram
2. What a legal diagram means – the semantics of a diagram. - 43How does a standard modelling language contribute to software development?A standard modelling language helps when new people join a project – a common modelling language reduces the time needed to enable them to become productive team members. Also, when a modelling language is widely used, it is likely that project components will have been constructed using that language. This makes the software easier and cheaper to maintain.
- 44What is the difference between a structural and a behaviour model?A structural model describes the elements of the system and their relationships to other elements. A behaviour model describes the behaviour of a system over a period of time.
- 45Unified Process (UP)A popular iterative and incremental process for building enterprise systems based on an object-oriented approach. It consists of four phases: inception, elaboration, construction and transition
- 46contingency tableA descriptive analysis tool that allows the relationship between two variables over categorical data to be compared. One variable’s values form the rows of a table, the other the columns. The row/column intersection shows information about the relationship between those values (counts of instances, for example) e.g Salary Band v. Highest Educational Qualification.