Secure Location-Independent Autonomic Storage Architectures

1
Secure Location-Independent Autonomic Storage
Architectures

• GR/S44501/01
• February 2004 - October 2007
• Graham Kirby, Alan Dearle, Stuart Norcross,Ron
  Morrison, Markus Tauber Rob MacInnis
• School of Computer Science, University of St
  Andrews
• graham, al, stuart, ron, markus,
  rob_at_cs.st-andrews.ac.uk

2
Overview

• Goal ubiquitous distributed storage
  infrastructure
• ease of use
• operate on non-trusted platform
• flexibility allowing trade-off among
• resilience of data
• performance
• capacity

3
Research Progress

• Core storage infrastructure
• scalable, location-independent data storage and
  retrieval
• Byzantine tolerance
• withstands benign or malicious failure of
  participating nodes
• Autonomic management
• maintains data replication, caching placement
• Spin-offs
• generic autonomic manager
• P2P application toolkit
• flexible middleware

4
Related Work

• Research projects
• OceanStore
• relatively fixed inner ring
• primary-based Byzantine protocol
• Ivy
• concurrent updates can yield inconsistent views
• overhead increases with number of writers
• PAST
• no update
• ...
• Commercial
• Apple iDisk, Amazon S3
• remote storage model
• designed for server farm where Byzantine
  tolerance not an issue
• ...

5
System Requirements

• Desired properties
• scalability through decentralisation
• self-configuration
• resilience through replication
• automatic maintenance of replicated data
• consistent global view in face of concurrent
  update
• Storage model

6
System Architecture
7
(No Transcript)
8
(No Transcript)
9
(No Transcript)
10
(No Transcript)
11
(No Transcript)
12
(No Transcript)
13
(No Transcript)
14
(No Transcript)
15
Autonomic Management

• P2P layer
• scheduling of self-repair operations
• Storage layer
• resilience
• maintenance of replicas
• degree of replication
• distribution of replicas
• performance
• consistency/responsiveness trade-off
• client side caching
• predictive placement
• data block size
• encoding
• garbage collection

16
Conclusions

• Research contributions
• scalable, location-independent data storage
  infrastructure
• Byzantine tolerant services on un-trusted P2P
  network
• symmetric Byzantine update serialisation
  algorithm
• P2P application toolkit
• policy-free middleware
• Promising prototype
• much work still to do on autonomic management
• Funding applications
• further develop this approach
• apply to P2P-based distributed object model
• generalise P2P application toolkit
• platform for p-calculus based open services
• Project details http//asa.cs.st-andrews.ac.uk/

17
(No Transcript)
18
Publications

• Generating a Family of Byzantine Tolerant
  Protocol Implementations Using a Meta-Model
  Architecture. Submitted to DSN 2007 Workshop on
  Architecting Dependable Systems. 2007.
• Hosting Byzantine Fault Tolerant Services on a
  Chord Ring. Submitted to DSN 2007 Workshop on
  Architecting Dependable Systems. 2007.
• A Peer-to-Peer Middleware Framework for Resilient
  Persistent Programming. University of St Andrews
  Report CS/06/1. 2006.
• A Methodology for Developing and Deploying
  Distributed Applications. In Proc. 3rd
  International Working Conference on Component
  Deployment (CD2005), Grenoble, France, pp 37-51.
  2005.
• A Peer-To-Peer Infrastructure for Resilient Web
  Services. IEEE International Workshop on Advanced
  Architectures and Algorithms for Internet
  Delivery and Applications (AAA-IDEA 2005).
• RAFDA Middleware Supporting the Separation of
  Application Logic from Distribution Policy.
  University of St Andrews Report CS/05/3. 2005.
• Promoting Component Reuse by Separating
  Transmission Policy from Implementation.
  University of St Andrews Report CS/05/1. 2005.