Revolution

1
Revolution KidsBuilding the Future of the Net
Understanding the Structures of the World

• Bruce R. Schatz
• CANIS - Community Systems Laboratory
• University of Illinois at Urbana-Champaign
• schatz_at_canis.uiuc.edu, http//canis.uiuc.edu
• Special Holiday Lecture sponsored by IRIS-CISE
• National Science Foundation, Dec 16, 1997

2
Building the Future of the Net

• The Grand Challenge is
• Semantic Federation
• across a
• Billion Community Repositories

3
Evolution of the Net

• The Present Access
• The Net fetches documents
• The Future Organization
• The Net searches repositories
• The Millennium Analysis
• The Net correlates information
• From the Internet (data transmission)
• to the Interspace (information manipulation)

4
The Third Wave of Net Evolution
2010
Interspace
ARPANET
Internet
FUNCTION
Access
Organization
Analysis
1995
Distributed Files
Global Hypermedia
Distributed Objects
Global Semantics
SERVICES
Distributed Paths
1975
2000
UNITS
Packets
Files
Links
Objects
Concepts
Categories
1985
1965
PROTOCOLS
IP
FTP
CORBA
CP
HTTP
SMP
5
System Model Timeline

• 1984 Telesophy proposed at Bellcore
• revolutionary system prototype developed
• 1989 Schatz systems advisor at NCSA
• 20th Anniversary ARPANET Symposium
• 1994 NCSA Mosaic gains many users
• Mosaic 1M, Netscape 50M, Explorer 100M
• 1999 Web achieves Telesophy functionality
• browsing sharing multimedia documents

6
Telesophy
7
Publishing Cycle

• USER request
• LIBRARY reference
• INDEXER classify
• PUBLISHER quality
• AUTHOR generate
• users are authors, computers are publishers
• Every person machine performs Every role

8
Community System
results
data
(database management)
(electronic mail)
knowledge
(hypertext annotations)
literature
news
(information retrieval)
(bulletin boards)
Formal
Informal
browse and share all the knowledge of a community
9
Worm Community System

• WCS Information
• Literature Biosis, Medline, newsletter, meetings
• Data Genes, Maps, Sequences, strains, people
• WCS Functionality
• Browsing search, navigation
• Filtering selection, analysis
• Sharing linking, publishing
• WCS 250 users at 50 labs across the Internet

10
Worm Community System (WCS)
11
World of a Billion Repositories

• Every community has its own repository
• objects and pointers in information space
• Local collections but global solutions
• peer-peer architecture for infrastructure
• Net must support semantic correlation
• vocabulary switching in concept spaces

12
Levels of Indexes
13
Community Repositories

• repository is an organized collection
• DLI establishing large repositories for
  major publishers
• WCS integrated large formal (journals) and small
  informal (bulletins)
• need semantic retrieval for across publishers
• need semantic indexing for small publishers

14
Semantic Retrieval

• automatic indexing of concepts
• find context of terms (phrases) within documents
• generates concept space from co-occurrence
  frequency
• useful for interactive searching
• given a term, can suggest other terms
• merging concept spaces supports vocabulary
  switching
• concept spaces require supercomputing
• space for Inspec (400K) took 1 day on SGI
  Challenge
• 600 spaces for Compendex (4M) took 3.5 days on
  HP Convex Exemplar

15
Vocabulary Switching

• Grand Challenge of Digital Libraries
• semantic interoperability across subject domains
• vocabulary switching to suggest across domains
• Generating 1000 community repositories
• 600 categories across engineering (38 top-level)
  
• 150 categories across EE, CS, physics
• 3M raw abstracts, about 10M in community spaces
• large-scale supercomputer simulation
• 7 days of dedicated computation (10 days overall)
• have space navigation need space intersection

16
(No Transcript)
17
(No Transcript)
18
Interspace Prototype

• semantic retrieval concept spaces
• semantic interoperability vocabulary switching
• semantic indexing object categorization
• semantic clustering category maps
• information spaceflight region visualization
• analysis environment path correlations

19
Analysis Enviroments

• Concept Spaces for interactive suggestion
• Category Maps for semantic clustering
• Information Spaceflight for navigation
• examples from DLI Research
• http//csl.ncsa.uiuc.edu/interspace.html

20
Understanding the Structures of the World

• The Grand Challenge is
• Point-of-View Spaceflight
• across a
• Billion Community Repositories

21
Global Cultural Memory

• Enable Everyone to understand
• How They Have Lived and
• How They Will Live
• The Structures of Everyday Life
• recorded over space and time
• correlated in a global information space
• Appreciate the Past and Predict the Future

22
Evolutionary System Model

• Getty project using commercial technology
• Museum-style Web collection
• curators to classify from big sources
• Champaign County Historical information
• county-level community repository
• 5000 Historical Societies in US

23
(No Transcript)
24
Revolutionary System Model

• A planet for every kids local environment
• Federating the planets into a universe
• Ordering all planets from kids POV
• Flying through the Kids Universe
• Finding similar kids from different POVs
• Connecting historically through museums

25
(No Transcript)
26
KidsUniverse
27
Category Map (2D)
28
Information Spaceflight (3D)
29
Research Issues

• Community Repositories sovereign
  individual
• indexing all the knowledge of small groups
• Semantic Federation transient
  centralization
• creating virtual libraries from distributed
  repositories
• Information Analysis think globally,
  act locally
• correlating across repositories to solve problems
• The World of a Billion Repositories
• The Interspace of the 21st Century
• http//dli.grainger.uiuc.edu/_ppt/vanguard/vanguar
  d1/index.htm

30
Societal Implications

• Sovereign Individual
• community repositories for custom indexing
• Transient Centralization
• community curators as relationship bonders
• Think Globally, Act Locally
• vocabulary switches for correlation
  infrastructure
• Situational Analysis
• dynamic categorization for problem solving
• Zen of the Net
• at one with the knowledge of the world (mushin)