L-Store-SRM Interface

1
L-Store-SRM Interface

• Surya Pathak
• Wednesday, August 23rd 2006
• OSG Consortium meeting
• University of Washington, Seattle

2
What is L-Store?

• L-Store provides a distributed namespace for
  storing arbitrary sized data objects.
• Agnostic to the data transfer and storage
  mechanism. Currently only IBP is supported.
• Base functionality provides a file system
  interface to the data.
• Base version of L-Store has a single metadata
  server
• Next generation of this system (to be showcased
  at supercomputing) will be scalable in both
  Metadata and storage.

3
System Architecture
4
Goals L-Store-SRM interface

• Provide access to L-Store system in a transparent
  way for srm-users.
• Two options
• Design a generic GridFTP engine that can provide
  backdoor hookup points for different storage
  elements such as dCache, L-Store/IBP.
  (Reimplement from Timur/Patricks code base)
• Use Alexs srm-interface for the HPSS system and
  implement it for L-Store

5
System Design and Flow
./srm-copy (lets do an upload)

• mss Interface functions Implemented
• mssFileGet()
• mssFilePut()
• srmMakeDirectory()
• srmLs()
• srmGetFileSize()

• L-Store Façade uses L-Store API to provide
• fileGet()
• filePut()
• mkDir()
• ls() (recursive)
• Stat()

6
Current Development Status

• L-Store Façade has been completed
• Mss Interface and LStore façade together have
  been tested using a Test Client provide by Alexs
  group.
• We support/plan to support
• Uploads, downloads, mkdir and ls
• Plan to support third party transfers and deletes
  in near future
• Currently integration of the interface with an
  srm-client is in process. We plan for an alpha
  release in September
• Visit to LBNL in September coming up to finish
  the integration process

7
Server, client and version info

• Srm-server is based on srm v2.1.2
• Client is from the srm web page
• The TG Storage twiki has detailed instructions as
  to how the server and the client was set up.
• http//osg.ivdgl.org/twiki/bin/view/Integration/OS
  GSRMUserExperience

8
Deployment and future plans

• NSF funded project
• 8 initial sites
• Multiple disciplines
• Sat imagery (AmericaView)
• HEP
• Terascale Supernova Initative
• Structuraly Biology
• Bioinformatics
• Storage
• 500TB disk
• 200TB tape

Brazil ???