Introduction to Hadoop Technologies - PowerPoint PPT Presentation

About This Presentation
Title:

Introduction to Hadoop Technologies

Description:

This Hadoop tutorial provides a short introduction into working with big data in Hadoop via the Hortonworks Sandbox, HCatalog, Pig and Hive. By Quontra Solutions 204-226 Imperial Drive, Rayners Lane, Harrow HA27HH Email: info@quontrasolutions.co.uk Contact: +44(0)-20-3734-1498 / 1499 – PowerPoint PPT presentation

Number of Views:844

less

Transcript and Presenter's Notes

Title: Introduction to Hadoop Technologies


1
info_at_quontrasolutions.co.uk
HADOOP INTRODUCTION
By Quontra Solutions
www.quontrasolutions.co.uk

Contact 44(0)-20-3734-1498 / 1499
2
info_at_quontrasolutions.co.uk
About Quontra Solutions
  • Quontra Solutions is one of the leading players
    in the professional IT Training Services.
  • We believe the need of quality people in the IT
    Industry is growing and there are always
    opportunities for the best trained.
  • We have been providing the best training that
    suits the specific requirements of the student
    and also the current market trends.

www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
3
info_at_quontrasolutions.co.uk
OUR SERVICES
We provide Classroom training as well as Online
training so that one can take the training at the
comfort of their own home or office.
IT-Consulting and staffing
Online Training
In-Class Training
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Corporate IT-Training
Contact 44(0)-20-3734-1498 / 1499
4
info_at_quontrasolutions.co.uk
What is Hadoop
  • Hadoop is a software framework for distributed
    processing of large
  • datasets across large clusters of computers.
  • Large datasets ? Terabytes or petabytes of data
  • Large clusters ? hundreds or thousands of nodes

www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
5
info_at_quontrasolutions.co.uk
What is Hadoop (Contd)
  • Hadoop framework consists on two main layers
  • Distributed file system (HDFS)
  • Execution engine (Map Reduce)

www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
6
info_at_quontrasolutions.co.uk
Hadoop Master/Slave Architecture
Hadoop is designed as a master-slave
shared-nothing architecture
Master node (single node)
Many slave nodes
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
7
info_at_quontrasolutions.co.uk
Design Principles of Hadoop
  • Automatic parallelization distribution
  • Hidden from the end-user
  • Fault tolerance and automatic recovery
  • Nodes/tasks will fail and will recover
    automatically
  • Clean and simple programming abstraction
  • Users only provide two functions map and
    reduce

www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
8
info_at_quontrasolutions.co.uk
Who Uses Map Reduce/Hadoop
  • Google Inventors of Map Reduce computing
    paradigm
  • Yahoo Developing Hadoop open-source of Map
    Reduce
  • IBM, Microsoft, Oracle
  • Facebook, Amazon, AOL, Net Flex
  • Many others universities and research labs

www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
9
Hadoop Distributed File System (HDFS)
Centralized name node -
File F
Blocks (64 MB)
Many datanode (1000s)
www.quontrasolutions.co.uk
info_at_quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
10
info_at_quontrasolutions.co.uk
Effective course List
  • Microsoft Courses
  • Programming Courses
  • Digital Marketing
  • Networking Courses
  • Testing Tools
  • Business Analyst
  • Mobile Apps
  • Salesforce CRM
  • Hadoop

www.quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
11
info_at_quontrasolutions.co.uk
For More Hadoop In-depth Knowledge
Contact Us
QUONTRASOLUTIONS 204-226 Imperial Drive, Rayners
Lane, Harrow HA27HH Email info_at_quontrasolutions.c
o.uk Contact 44(0)-20-3734-1498 / 1499
www.quontrasolutions.co.uk
Contact 44(0)-20-3734-1498 / 1499
Write a Comment
User Comments (0)
About PowerShow.com