CLUSTER COMPUTING

1
CLUSTER COMPUTING

• Introduction to parallel computing

2
????? ???

• ?? ??? ????? ??? ??????? ???? ????? ??? ?? ?????
  ??? ??? ????? ?? ????
• 1 ???? ??? ?? ????? ?? ?? ????????
• 2 ????? ???? ?????? ?? ??? ??? ?????
• 3 ????? ?????????? ?? ??? ?? ?? ?????
• 4 ????? ??? ?? ?????????? ?? ?? ????

3
????? ?????

• ??????? ????? ???? ??????? ?? ??? ???????? ??????
  ???? ?? ?? ????? ?? ????? ??? ???
• 1 ???? ??? ????? ????????
• 2 ????? ???? ?????? ??? ??? ?? ???? ?? ???????
  ?????? ????? ????
• 3 - ????? ?? ??? ?? ?????? ?????????? ???
• ????? ?????????? ??? ?? ??? ??? ?? ????????

4
?????????? ????? ???
5
??? ?????? ?? ??? ?????? ?????

• Task
• Parallel Task
• Serial Execution
• Parallel Execution
• Shared Memory
• Distributed Memory
• Communication
• Synchronization
• Granularity
• Coarse
• Fine
• Observed speadup
• Parallel Overhead
• Massively Parallel
• Scalability

6
???? ???? ?????????? ?? ??? ????? ??????

• S I S D
• Single Instruction, Single Data

• S I M D
• Single Instruction, Multiple Data

????? ??? ?????? ??
7
???? ???? ?????????? ?? ??? ????? ??????

• M I S D
• Multiple Instruction, Single Data

• M I M D
• Multiple Instruction, Multiple Data

????? ???? ??? ????? ?????
8
????? ?? ????? ?????

• Distributed memory

• Shared memory

Hybrid Distributed Share Memory
9
??? ??? ????? ?????? ?????

• SHARED MEMORY
• THREADS
• MESSAGE PASSING
• DATA PARALLEL
• HYBRID
• Other
• SPMD (Single Program-Multiple Data)
• MPMD(Multiple Program-Multiple Data)

10
Message Passing
MPI 1994 MPI-2 1996
11
????? ?????? ??? ?????

• ????? ??? ??? ??? ?? ?????? ????? ?? ?? ?? ??????
  ????? ???? ????
• ??? ????? ???? ?????? ?? ??? ??? ?????
  (Partitioning) ??? ?? ?? ?? ??? ????? ?? ???

Domain Decomposition
Functional Decomposition
12
Granularity

• ???? ???? ???? ????? ??????? ?? ???? ????? ?
  ?????? ???????
• Fine-Grain Parallelism
• Coarse-grain parallelism
• ?? ???? ???? Computational work / communication
  ???? ? ?? ???? ??? ???? ???? ???. ?? ????
  Fine-Grain ?? ???? ???? ??????? ???? ???.

13
????? ??????
Cluster Management Tools
Physical Setup (Racks)
14
?????

• ?????? ??????
• ???? ??? ???? ? ?????? ???????? ???. ?? ??????
  ??? ?????? ??? ???? ?? ???? ?? ??? ????.
• ????????
• ????? ???? (cache)
• ????? ????? (RAM)
• ??? ????? (system bus)

15
????????
16
????? ? ?????? ??? ????

• ????
• ???? ????
• ???? ???????

17
IP FORMAT
8 bit 110
8 bit 93
8 bit 16
8 bit 172
?? Ip ?? ?? ??? ????? ??? Network ? Host
18
??????? IP

• Class A Network Host Host Host
• 0000 00000 to 0111 1111127
• ??? ??? ????? ??? ???
• Class B Network Network Host Host
• 1000 0000128 to 1011 1111191
• ??? ??? ????? 1 ? ??? ??? ????? ??? ???.
• Class C Network Network Network Host
• 1100 0000192 to 1101 1111223
• ?? ??? ??? ????? 1 ???.

19

• 0000 this network
• 1111 all network
• 127.0.01 localhost
• ----- ----- 0000 0000 ?????? ???? ??? ???? ???
  ????? This node
• ----- ----- 1111 1111 ????? ???? ??? ???? 1 ????
  All nodes
• 1111 1111 1111 1111 (255.255.255.255)
• ??? ? ????? ?? ???? ????
• ???? 128.2.255.255 ???? ???? ????? ?? ???? ?
  128.2 (???? B)

20
????? ???? ????????
21
????
MASTER
Gateway
nodeN
node1
node2
22
Required NIS Server Daemons
23
????

• Edit /etc/sysconfig/network File
• /etc/sysconfig/network
• NISDOMANE pwscf.iut
•  
• Edit your /etc/yp.conf File
• /etc/yp.conf - ypbind configuration file
• ypserver 127.0.0.1
• ?? ???? ??? ?? ?? ?????? vi ?? ?????? ?????? ????
• service portmap start
• service yppasswdd start
• service ypserv start
• chkconfig portmap on
• chkconfig yppasswdd on
• chkconfig ypserv on
• rpcinfo p localhost

24
????? ??? NIS ????

• /usr/lib/yp/ypinit m
• ?? ?? ????? ??? ????? ?? ??? ??? ???? ?? ????
  ???? ? ?? ??? ??? ??????? ????? ?? ?? ??????
  ????? ??? ?? ?? ????? ? ??? ???? ?? ???? ?????
  ???? CTRL-D ?? ?????. ?? ??? ????? ??? ???? ?? ??
  ????? y ?? ?????.
• Service ypbind start

25
????? ???? ?????

• useradd g users user1
• passwd user1
• changing passwd user1
• new password
• Retype new password
• passwd all authentication tokens updated
  successfully.
• make C /var/yp
• ?? ?? ??? ????? ?? ?? logout ??? ? ???? ????.

26
Configuring the NIS client

• ?? ????? authconfig ??????? ?? ????
• authconfig tui
• ?? ?? ????? ??? ????? ???? /etc/yp.conf ????? ??
  ??? ?? ?? ?? ?????? ??? ?? IP ???? ? ????? ??
  ???? ?? ???. ?????? ??? ????? ?? ????
  /etc/sysconfig/network ????? ?? ???.
•  
• /etc/yp.conf - ypbind configuration file
• domain chemclust.iut server 192.168.1.100
• /etc/sysconfig/network
• NISDOMAINpwscf.iut
• service portmap start
• service ypbind start
• chkconfig ypbind on
• chkconfig portmap on
• rpcinfo p localhost
•  

27
REMOTE DISK ACCESS WITHNFS

• ?? ???? ??? ??? ? ?????? nfs ?? ??? ?? ??? ?
  ????? ??? ??? ???? ?? ???. ?? ??????? ??? ?? ????
  nfs ? portmap ????? ????.
• root_at_localhost rpm -qa grep nfs
• system-config-nfs-1.3.10-1
• nfs-utils-1.0.7-8
•  
• root_at_localhost rpm -q portmap
• portmap-4.0-65
• ???? /etc/exports ???? ?? ?? ??? ??? ?????? ????
• etc/exprts
• /home 172.16.93.0 (rw,sync)
• ?? ??? ????? ?? ????????? ?? ??? ???? ?? ????? IP
  ????? 172.16.93.1 ?? 192.16.93.254 ?? ?????
  ???? /home ?? ?????? ? ??? ???? ????? ??? mount
  ???

28

• ???? ????? nfs ? portmap ????? ??? ??? ??????
  ????.
• chkconfig --level 35 nfs on
• chkconfig --level 35 nfslock on
• chkconfig --level 35 portmap on
• service portmap start
• service nfs start
• service nfslock start
•  
• ??? ????
• rpcinfo p localhost

29
??????? nfs ??? ??????

• chkonfig --level 35 netfs on
• chkconfig --level 35 nfslock on
• chkconfig --level 35 portmap on
•  
• service portmap start
• service netfs start
• service nfslock start
• ??? ????
• rpcinfo p
• ?????? ???? /etc/fstab
• ???? fstab ???? ???? ??????????? ?? ???? ???
  ???????? ???? ??? ??? mount ???? ?? ????. ?? ????
  ??? ?? ??? ?? ?? ??? ???? ????? ????.
• 192.168.1.100/home /home nfs rw 0 0
• ???? ?? ????????? ?? ??? /home ??????
• mkdir /home
• mount a
• ??? ?????? ?? ???? /etc/exports ??? ???? ?????
  ????? ??? ?? ???? ????.
• exportfs a

30
CONFIGURING AND USING SSH

• ?????? ?? ??? ?? ?????? ? ?? ???? ?? ??? ?????? ?
  ????? ??? ???? ????. ?? ???? ??????? ????? ??? ??
  ???? ????
• ssh-keygen t rsa  
• ?? ?? ????? ??? ????? ?? ???? ?? ?????? ??????
  ??? ??? ?? ????? ????.
• ??? ?? ????????? /home/user1/.ssh ???? ? ????
  identity.pub ?? ?? ??? authorized_keys2 ???
  ????.
• cd /home/user1/.ssh
• cp identity.pub authorized_keys2