Large Scale Data Collections

1
Large Scale Data Collections

• Provide requirements
• Data sharing - data grids
• Data publication - digital libraries
• Data preservation - persistent archives
• Emerging commonality of capabilities
• Data management infrastructure - bits
• Information management - semantic tags
• Knowledge management - relationships

2
10-Year Vision

• Integration of knowledge management technologies
• Integration of information repositories into
  infrastructure
• Integration of relationship repositories into
  infrastructure
• Knowledge generation to shorten innovation cycle
• Application of knowledge management
• Consistency constraints between services
• Federation of collections
• Context definition - evidence-based relationships

3
Implications

• Interactions with user communities is essential
• Scientific, education, cultural history
  collections
• Interactions between technology development
  communities
• Semantic web, data grid, persistent archive, IR,
  data mining,
• Scalability of infrastructure
• Today have catalogs with 1 billion records,
  collections with gt1 PetaByte of data
• Define a context for each person (300 million)

4
Group 1

• Participants
• Christina Borgman
• Gregory Crane
• Jim French
• Jose Marie Griffiths
• Judith Klavans
• Carl Lagoze
• Reagan Moore
• Shiego Sugimoto
• Norman Wiseman

5
Tasks

• Identify disruptive and transformative
  technologies/opportunities for digital libraries
• Who cares and Why
• Where to place the stake in the ground -
  strategic
• Identify long term compelling vision

6
Long Term Vision

• Generation Information
• Management of Intellectual Capital
• Preservation Knowledge
• Re-use Cultural History

7
Compelling Vision

• Structure information from the perspective of an
  individuals context
• Large scale information integration
• Personalization of information content
• Context based interpretation of information from
  ubiquitous resources
• Pro-social communication campaigns with targeted
  information
• Personal information technology
• Interaction with knowledge stores
• Natural interaction mechanisms, dialogue
  management for social presence

8
Compelling Vision

• Wellness for life
• Authoritative information to the right person at
  right time
• Personal genome management, impact of personal
  habits on disease risk
• Consistent access/extraction of knowledge
• e-Learning, e-Science
• Transform education by access to new forms of
  information and knowledge
• Inquiry based learning, promotion of learning
  models
• Technology impact on education analysis

9
Compelling Vision

• Creation of virtual learning environments
• Roman forum
• Scientist lab
• Institutional infrastructure
• Cyberinfrastructure extension into academia
  through information and knowledge management
• Extracting structured information
• Inferences between relationship spaces to create
  new knowledge
• Recognition of valid knowledge
• Taming the knowledge frontier

10
Compelling Vision

• Convergence of technologies for digital
  libraries, data grids, persistent archives.
• Data, information, knowledge organization
• Personal digital library federation
• Eliminate information overload
• Knowledge bases as commodities
• Evidentiary based event relationships
• Evidence based relationships
• Authority generation
• Digital government - knowledge-based governance
• Digital divide, equity, intellectual property

11
Compelling Vision

• Generate, manage, preserve, and apply knowledge
• Stand on the shoulders of knowledge giants
• Identifying knowledge from sensor-based
  communications
• Spam filters
• How to manage information in ubiquitous data

12
Four Major Topics

• Ubiquitous access to personalized knowledge
• Knowledge extraction from unstructured data
• Natural communication of information
• Transform education through inquiry based
  learning
• Knowledge life cycle for generation, management,
  preservation, repurposing
• Cyberinfrastructure extension into institutional
  infrastructure for digital library, data grid,
  persistent archive
• Personal organization of knowledge

13
Scenarios

• (1) Ubiquitous access to personalized knowledge
• Access to all information, personalized for
  individual needs by place and time
• (2) Knowledge extraction from unstructured data
• Self-organizing information, knowledge generation
• (3) Natural communication of information
• Socialization of knowledge
• (4) Transform education by inquiry based learning
• (5) Knowledge life cycle
• (6) Extension of cyber infrastructure
• (7) Personal organization of knowledge

14
Big Story

• 10-years in future, there will be a pervasive
  knowledge environment, accessed by all
• (1) Pervasive information environment, users get
  information/knowledge at any place at any time
  for any context, identify opportunities for new
  knowledge
• (2) More natural means of interacting with
  knowledge, immersion in concept space
• Socialization of knowledge for public good,
  wellness for life
• Inquiry based education, create, manage, and
  share personal digital library of knowledge
  spaces
• (3) Highly curated resources as organizational
  framework for knowledge
• (4) Cyberinfrastructure enabling preservation
  within institutions including sustainability

15
Scenario

• Person drives into Chatham
• Takes a picture, adds to a community collection
• Annotates with history of site
• Incorporates into genealogy
• Points to related sites of ancestor homes
• Maps to county information for current owner
• Builds a knowledge space / personal digital
  library
• Publishes knowledge space on web
• Preserves as part of community knowledge space
• Community knowledge space integrated into
  national cyberinfrastructure

16
CyberInfrastructure

• NSF Directorate collaborations
• National Virtual Observatory data grid /
  collections
• Ocean Sciences data grid / digital library
• National Science Digital Library - educational
• ITR - GEON, SEEK, SCEC, GriPhyN data grids
• NPACI data intensive computing
• DL Research activities
• Synthesis of technologies to build the
  cyberinfrastructure