Title: Introduction to Hadoop Technologies
1info_at_quontrasolutions.co.uk
HADOOP INTRODUCTION
By Quontra Solutions
www.quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
2info_at_quontrasolutions.co.uk
About Quontra Solutions
- Quontra Solutions is one of the leading players
in the professional IT Training Services. - We believe the need of quality people in the IT
Industry is growing and there are always
opportunities for the best trained. - We have been providing the best training that
suits the specific requirements of the student
and also the current market trends.
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
3info_at_quontrasolutions.co.uk
OUR SERVICES
We provide Classroom training as well as Online
training so that one can take the training at the
comfort of their own home or office.
IT-Consulting and staffing
Online Training
In-Class Training
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Corporate IT-Training
Contact 44(0)-20-3734-1498 / 1499
4info_at_quontrasolutions.co.uk
What is Hadoop
- Hadoop is a software framework for distributed
processing of large - datasets across large clusters of computers.
- Large datasets ? Terabytes or petabytes of data
- Large clusters ? hundreds or thousands of nodes
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
5info_at_quontrasolutions.co.uk
What is Hadoop (Contd)
- Hadoop framework consists on two main layers
- Distributed file system (HDFS)
- Execution engine (Map Reduce)
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
6info_at_quontrasolutions.co.uk
Hadoop Master/Slave Architecture
Hadoop is designed as a master-slave
shared-nothing architecture
Master node (single node)
Many slave nodes
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
7info_at_quontrasolutions.co.uk
Design Principles of Hadoop
- Automatic parallelization distribution
- Hidden from the end-user
- Fault tolerance and automatic recovery
- Nodes/tasks will fail and will recover
automatically - Clean and simple programming abstraction
- Users only provide two functions map and
reduce
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
8info_at_quontrasolutions.co.uk
Who Uses Map Reduce/Hadoop
- Google Inventors of Map Reduce computing
paradigm - Yahoo Developing Hadoop open-source of Map
Reduce - IBM, Microsoft, Oracle
- Facebook, Amazon, AOL, Net Flex
- Many others universities and research labs
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
9Hadoop Distributed File System (HDFS)
Centralized name node -
File F
Blocks (64 MB)
Many datanode (1000s)
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
10info_at_quontrasolutions.co.uk
Effective course List
www.quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
11info_at_quontrasolutions.co.uk
For More Hadoop In-depth Knowledge
Contact Us
QUONTRASOLUTIONS 204-226 Imperial Drive, Rayners
Lane, Harrow HA27HH Email info_at_quontrasolutions.c
o.uk Contact 44(0)-20-3734-1498 / 1499
www.quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499