DIS PROPOSAL - Distributed Data Warehouse -

1
DIS PROPOSAL - Distributed Data Warehouse -

• R92725032 ???
• R92725042 ???

2
Outline

• Motivation and Goals
• System Architecture diagram
• Justification
• Alternatives
• System Requirement
• Testing
• Timeline
• Job distribution

3

• Motivation
• Solve the problem of data access on multiple
  computers
• Support virtual file serving
• Goals
• Provide distributed ftp file sharing
• Dynamic join and leave of service node
• Provide corresponding mechanism for server crash.

4
System Architecture and Diagram
5
Description

• Server side
• FTP Server
• Accept clients request
• Invoke remote file system API or directly call
  local file system
• Return files requested by client through FTP
• Remote File System
• Use RMI to communicate with remote file system of
  others service node.
• Join service pool
• -Broadcast its own address to all service
  nodes inside service pool, all nodes, which
  maintain a server list, update its own server
  list and construct RMI connection with the new
  node.

6
Description

• Client Side
• Login the system using common ftp client
  application
• Get a global view of file service pool
• Receive file transited by the system
• (the same as normal ftp client application)

7
Justification

• File Location Transparency
• Provide a file system with global view using J2SE
• Failure Handling
• When service crash, system automatically unmount
  remote file system and update directory
• Scalability
• Provide service node join or exit our system
  dynamically

8
Alternatives
9
Alternatives (cont)

• FTP server
• original Let FTP Server call remote file system
  of sub-layer, and use sub-layer to handle data
  transmission
• other way Use upper-layer FTP to connect
• Service Nodes
• original Use broadcast to let service node
  dynamically join the service pool
• efficient way Consider to add a coordinator as a
  entry point,and manage all of the service nodes

10
System Requirement and Implementation

• Requirement
• Hardware
• 4 computers(3 servers and 1 client)
• Software
• Platform Java VM on Windows or Linux
• Middleware Java RMI
• Implementation
• J2SE(JDK1.4)
• Borland JBuilder, eclipse

11
Testing

• Join leave testing
• Service node failure handling

12
Implementation Timeline
ID ???? ???? ???? ?? 2003 2003 2004
ID ???? ???? ???? ?? ??? ??? ??
1 System analysis 2003/11/1 2003/11/8 1W
2 System design 2003/11/9 2003/11/16 1W
3 System development 2003/11/17 2003/12/29 6W
4 System testing 2003/12/30 2004/01/20 3W
13
Job Distribution

• ???Virtual file system and FTP server daemon
• ???Remote file system and service pool
  management mechanism