Enter text here

BIGDATA

1. Frequent itemsets,market basket

   • A large Set of item A large set of baskets,each of which is the small set item
   • COmputatin model
     • Data is stored basket by Basket How many time did the file will be read Pass to Main memory

2. A Prioro Algorithm

   • Find the pair of items,that appear at least s-times together
   • A priori algorithm -2
     • A two passed approach called a priori limits the needed for main memory if  a set items appear  at least  s times
   • A priori Algorithm -3
     • Read Basket and count main memory the occurrences of each item Read basket again and count in only those pair both of which were found in pass one to have occured at least S times

3. Hash -based improvement

   • Imagine the rows permuted randomly.

4. One or two passed approximation

   • SUPRINGS PROPERTY
     • •The probability (over all permutations of the rows) that h (C1) = h (C2) is the same as Sim (C1, C2). •Both are a /(a+b +c)!

5. High Correlation Mining

6. APPLICATION

   • WORD IN DOCUMENT
   • DOCUMENTS IN SENTENCES
   • LINK AMONG WEB PAGES

7. MATRIX REPRESENTATION

8. TYPES OF ROWS

   •  A        1      1 B         1      0 C         0      1 D         0       0

9. HADOOP

   • Hadoop is an open-source software framework for storage and large scale processing of data-sets on clusters of commodity hardware.  Hadoop is an Apache top-level project being built and used by a global community of contributors and users.  It is licensed under the Apache License 2.0.
   • COMPOUNDS
     • MAP REDUCE
     • Hadoop Distributed File System
       • a distributed file-system that stores data on the commodity machines, providing very high aggregate bandwidth across the cluster.
     • Hadoop YARN
       • a resource-management platform responsible for managing compute resources in clusters and using them for scheduling of users' applications.
   • APPLICATION
     • IMAGE PROCESSING
     • Marketing analytics