Big Data, Hadoop and Spark notes
18 notes by 17 users
This Big Data, Hadoop and Spark page gathers a small set of community-made notes, from big data concepts to filtering and mapping in Spark. University students can practice working through these ideas, while teachers can find material to share. The collection is mainly university-level. Start with a note that matches your topic.
Select topic
- Big Data History and Evolution14
- Big Data Concepts and Characteristics44
- Big Data Architecture and Engineering16
- Big Data Storage and NoSQL12
- Big Data Analytics18
- Data Analytics Lifecycle9
- Big Data Applications in Business13
- Cloud Computing for Big Data15
- Hadoop Architecture and Ecosystem57
- Hadoop MapReduce5
- Big Data Processing Tools10
- Apache Spark11
Notes
-
BIG DATA - created from Mind Map ORIGIN IMPLICATIONS MAIN DEFINITIONS
-
Spark learning Strongly typed language and week typed:- The difference between a strongly typed language and a weakly typed language is basically that a strongly typed language checks the type of a variable before performi...
-
FIRST CHAPTER FACTS - CLASS 2 - There are 2.5 quintillion data per day being generated; - 90% of the data generated on the planet was generated in the last two years; - 80% of data is unstructured or in different formats;...
-
BIG DATA - creado desde un Mapa Mental Origin of Big Data Main Definitions Motivations
-
Big Data - created from Mind Map Scale out, not up limits of large shared-memory machines Move processing to the data cluster have limited bandwidth Process data sequentially, avoid random access Seamless scalability  ...
-
Filter and Map Filter data //create person.txt Name, Age Vinayak, 35 Nilesh, 37 Raju, 30 Karthik, 28 Shreshta,1 Siddhish, 2 val personfile = sc.textFile("C:/Users/Redirection/pateln7/Downloads/SPARK/person.txt") val fi...
-
Big Data Examples - Volume Banking- Billions of transactions per year take place and full details of every transaction must be tracked and stored in order to create an audit trail for possible fraud investigation. Mobile phone...
-
Sqoop - creado desde un Mapa Mental The traditional application management system, that is, the interaction of applications with relational database using RDBMS, is one of the sources that generate Big Data. Sqoop Import - imports individual tables from...
-
Joins // JOINS ===================================== Using RDD //emp table id,name,age 1,Vinayak, 35 2,Nilesh, 37 3,Raju, 30 4,Karthik, 28 5,Shreshta,1 6,Siddhish, 2 val emp = sc.textFile(...
-
Big Data - created from Mind Map Definition Technologies Big science
-
BIG DATA ANALYSIS - created from Mind Map DEFINITION EXAMPLE ENTERPRISE BIG DATA
-
Untitled
-
BIG DATA - created from Mind Map Enter text here Big Data usually includes data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed time.  ...
-
Big Data Engineer - created from Mind Map Data Visualization Data Processing Data Ingest
-
Hadoop - created from Mind Map 1- Modules 2- Supporters Apache Hadoop is an open-source, Java-based, distributed computing platform, built out of the necessity to scale search indices
-
Big Data - created from Mind Map Present a Business Case to Manager Choice of No SQL Database Buzzwords
-
Big data technologies Big data logical layers 1. Big data source layer. 2. Data messaging and storage layer - this is calle as integration layers as well
-
BIG DATA - created from Mind Map
More Big Data, Hadoop and Spark resources
About big data, hadoop and spark notes
GoConqr OriginalExplore Big Data, Hadoop and Spark notes
These notes offer different ways into the unit. Big Data uses examples to introduce the subject, while Filter and Map includes a Spark code example for filtering data. Other notes cover topics such as Sqoop, big data analysis and Hadoop.
For a starting point, try Big Data if you want to work through examples. If you are focusing on Spark code, begin with Filter and Map and follow the example line by line. The notes on Sqoop are another place to look when studying how data moves between systems.
Study with notes
Read a short section, then set it aside and explain its main idea in your own words. Return to the note to check what you missed. If you want a visual overview, switch to a mind map on the unit page; use a quiz there when you want to check your understanding.
Choose a note and work through it at your own pace.
Frequently asked questions
Which note should I start with?
Start with Big Data if you want examples to help you approach the topic. For a code-focused starting point, choose Filter and Map, which includes a Spark filtering example. You can also look through the other titles and select one that matches the material you are studying.
What do the notes cover?
The collection includes notes on big data concepts, Spark learning, filtering and mapping, Sqoop, big data analysis and Hadoop. There are also notes titled Joins and Big data technologies. The resources take different approaches, so their titles can help you find a useful starting point.
Are these notes free to use?
Yes. Every resource listed here is free to open and study, with no account needed. The notes were made by GoConqr users. A free account also lets you save quiz scores and make your own quizzes, mind maps, flashcards and notes.