Communitydriven Ontology Construction and Maintenance: Combining Human and Computational Intelligenc

1
Community-driven Ontology Construction and
MaintenanceCombining Human and Computational
Intelligence

• PhD Seminar, Vienna
• Katharina Siorpaes
• September 2007

2
Contents

• Problem Statement
• Observations and Motivation
• Contribution
• Approach
• Related Work
• Evaluation Methodology
• Conclusion
• Publications

3
Problem Statement

• Academia

• Real-world ontolgies
• ?

4
Observations

• Break with language as a resource
• Language and lexical resources need to be better
  integrated with building ontologies
• Discourse that led to a definition is usually not
  available

Ontologies formal vs. Informal 17
5
Observations (contd)

• Conceptual Dynamics Bottleneck 15

6
Observations (contd)

• Ontology Perspicuity Bottleneck
• Group of engineers
• Commitment requires understanding
• Constructs (such as subClassOf)
• Intended meaning of elements
• Only communication channel ontology
  serialization
• ? user community no or limited control over
  evolution of ontology

Ontology Perspicuity Bottleneck 4
7
Motivation
8
Motivation (contd)

• Preliminary evidence for this assumption
• Fact Almost 1.5 Million stable concepts in the
  English version of Wikipedia

Hepp, M., K. Siorpaes, and D. Bachlechner
Harvesting Wiki Consensus Using Wikipedia
Entries as Vocabulary for Knowledge Management.
IEEE Internet Computing, Vol. 11, No. 5, pp.
54-65, Sept-Oct 2007.
9
Contribution

• A methodology (and implementation) for
  community-driven Ontology Construction in order
  to...
• Show how ontology engineering can benefit from
  combining (collective) human and computation
  intelligence
• Investigate incentive structures for ontology
  building inspired by Web 2.0

10
Approach
11
Approach Methodology and Ontology Lifecycle
12
Lightweight Ontologies

• Trade-off between expressivity and what lay
  people can understand and use
• Classes
• Datatype and object properties
• Instances
• Subsumption hierarchy (subClassOf)
• Mapping constructs

"We expect the majority of the ontologies on the
Semantic Web to be light-weight. ()
Our experiences all point to light weight
ontologies as the most commonly occurring
type. (Davies, Fensel et al. 2002)
Expressivity-Communitysize-Frontier 4
13
Related Work

• Collaborative Ontology Building
• Tadzebao and WebOnto (Domingue, 1998)
• DILIGENT (Vrandecic et al., 2005)
• OntoEdit (Sure et al., 2002)
• HCOME Methodology (Kotis and Vouros, 2005)
• Ontology Maturing (Braun et al., 2006)
• DOGMAMESS (De Moor, De Leenheer et al. 2006 )
• Semantic Wikis
• Makna 11 and IkeWiki 12
• Semantic Wikipedia 13
• Platypus Wiki 14

14
Implementation

• Sesame 2.0 Triple Store
• Sesame 2.0 Java API
• Java JSP

15
Implementation (contd)
16
Evaluation Methodology

• Release of the prototype to different communities
  (Semantic Web/Computer Science, Industrial
  Partners in Project, ...)
• Analysis of data
• Comparison of domain ontologies produced in the
  (1) traditional and (2) community-driven ontology
  engineering approach
• Dimensions (preliminary)
• Domain coverage
• Stability of concept definitions
• Cost
• Precision of usage

17
Conclusion

• Lack of domain ontologies
• Limited user involvement
• Wiki philosophy is a way to allow many users to
  contribute and to tap the collective intelligence
  of a community
• Ontology construction can benefit from the
  integration of external resources
• Methods to combine human and computational
  intelligence

Group solutions usually outperform the groups
individuals solutions 20, 21, 22
18
PhD-related Publications

• Siorpaes, K. and M. Hepp, OntoGame Towards
  Overcoming the Incentive Bottleneck in Ontology
  Building, in Proceedings of the 3rd International
  IFIP Workshop On Semantic Web Web Semantics
  (SWWS '07) co-located with OTM Federated
  Conferences. Springer LNCS Vilamoura, Portugal,
  November 29-30, 2007. (forthcoming)
• Siorpaes, K. and M. Hepp, OntoGame Turning
  Ontology Engineering into an Online Game with a
  Purpose, in Poster and Demo Proceedings of the
  6th International Semantic Web Conference (ISWC
  2007). Busan, Korea, November 11-15, 2007.
  (forthcoming)
• Siorpaes, K., M. Hepp, and A. Klotz, The Sediment
  Metaphor Serendipity for Browsing Ontologies, in
  Poster and Demo Proceedings of the 6th
  International Semantic Web Conference (ISWC
  2007). Busan, Korea, November 11-15, 2007.
  (forthcoming)
• Siorpaes, K., M. Hepp, A. Klotz, and M. Waltl,
  myOntology Tapping the Wisdom of Crowds for
  Building Ontologies, in Poster and Demo
  Proceedings of the 6th International Semantic Web
  Conference (ISWC 2007). Busan, Korea, November
  11-15, 2007. (forthcoming)
• Siorpaes, K., Lightweight Community-driven
  Ontology Evolution, accepted for the Doctoral
  Consortium at the 6th International Semantic Web
  Conference (ISWC 2007) in Proceedings of the 6th
  International Semantic Web Conference (ISWC
  2007), Springer LNCS, Busan, Korea, November 11,
  2007. (forthcoming)
• Hepp, M., Siorpaes, K., and D. Bachlechner,
  Harvesting Wiki Consensus Using Wikipedia
  Entries as Vocabulary  for Knowledge Management,
  IEEE Internet Computing , Vol. 11, No. 5, pp.
  54-65 , Sept-Oct  2007. (forthcoming)
• Siorpaes, K. and M. Hepp, myOntology The
  Marriage of Collective Intelligence and Ontology
  Engineering , in Proceedings of the Workshop
  Bridging the Gap between Semantic Web and Web 2.0
  at the ESWC 2007. LNCS Springer Innsbruck,
  Austria, June 7, 2007.
• Van Damme, C., M. Hepp, and K. Siorpaes,
  FolksOntology An Integrated Approach for Turning
  Folksonomies into Ontologies , in Proceedings of
  the Workshop Bridging the Gap between Semantic
  Web and Web 2.0 at the ESWC 2007. LNCS Springer
  Innsbruck, Austria, June 7, 2007.
• Siorpaes, K., Towards Open Ontology Engineering ,
  in Proceedings of the Knowledge Web PhD Symposium
  2007 co-located with the 4th Annual European
  Semantic Web Conference (ESWC 2007). Innsbruck,
  Austria, June 6, 2007.
• Hepp, M., D. Bachlechner, and K. Siorpaes,
  Harvesting Wiki Consensus - Using Wikipedia
  Entries as Ontology Elements , in Proceedings of
  the 1st Workshop SemWiki2006 - From Wiki to
  Semantics, co-located with the 3rd Annual
  European Semantic Web Conference (ESWC 2006) .
  2006 Budva, Montenegro.
• Hepp, M., D. Bachlechner, and K. Siorpaes.
  OntoWiki Community-driven Ontology Engineering
  and Ontology Usage based on Wikis . in
  Proceedings of the 2005 International Symposium
  on Wikis (WikiSym 2005) . 2005. San Diego,
  California, USA.

19
References

• 1. Fensel, D., Ontologies Dynamic networks of
  formally represented meaning, in Rejected for
  SWWS'01, The first Semantic Web Working
  Symposium. 2001 Stanford University, California,
  USA.
• 2. Hepp, M., D. Bachlechner, and K. Siorpaes,
  Harvesting Wiki Consensus - Using Wikipedia
  Entries as Ontology Elements, in Proceedings of
  the 1st Workshop SemWiki2006 - From Wiki to
  Semantics, co-located with the 3rd Annual
  European Semantic Web Conference (ESWC 2006).
  2006 Budva, Montenegro..
• 3. Hepp, M., K. Siorpaes, and D. Bachlechner,
  Harvesting Wiki Consensus Using Wikipedia
  Entries as Ontology Elements for Knowledge
  Management. IEEE Internet Computing, 2007.
  submitted)
• 4. Hepp, M., Possible Ontologies How Reality
  Constrains the Development of Relevant
  Ontologies. IEEE Internet Computing, 2007. 11(7)
  p. 96-102.
• 5. Hepp, M., Güterklassifikation als semantisches
  Standardisierungsproblem. 2003, Wiesbaden
  Deutscher Universitäts-Verlag.
• 6. Fensel, D., Ontologies A Silver Bullet for
  Knowledge Management and Electronic Commerce. 2nd
  ed. 2004, Berlin etc. Springer.
• 7. Surowiecki, J., The Wisdom of Crowds. 2003,
  New York Anchor Books Random House Inc. 284.
• 8. Domingue, J. Tadzebao and WebOnto Discussing,
  Browsing, and Editing Ontologies on the Web. in
  11th Knowledge Acquisition for Knowledge-Based
  Systems Workshop. 1998. Banff, Canada.
• 9. Vrandecic, D., et al., The DILIGENT knowledge
  process. Journal of Knowledge Management, 2005.
  9(5) p. 85-96.
• 10. Sure, Y., et al. OntoEdit Collaborative
  Ontology Engineering for the Semantic Web. in
  International Semantic Web Conference 2002 (ISWC
  2002). 2002. Sardinia, Italia.
• 11. Dello, C., E. Paslaru Bontas Simperl, and R.
  Tolksdorf. Creating and using semantic content
  with Makna. in Wiki meets Semantics workshop at
  the ESWC2006. 2006. Budva, Montenegro.
• 12. Schaffert, S. IkeWiki A Semantic Wiki for
  Collaborative Knowledge Management. in 1st
  international workshop on Semantic Technologies
  in Collaborative Applications STICA06. 2006.
  Manchester, UK.
• 13. Völkel, M., et al. Semantic Wikipedia. in
  15th international conference on World Wide Web
  (WWW2006). 2006. Edinburgh, Scotland.
• 14. Campanini, S.E., P. Castagna, and R. Tazzoli.
  Platypus Wiki a Semantic Wiki Wiki Web. in 1st
  Italian Semantic Web Workshop Semantic Web
  Applications and Perspectives (SWAP). 2004.
  Ancona, Italy.
• Hepp, M., Ontology Maintenance Quantifying the
  Conceptual Dynamics in Domain Ontologies. 2007,
  DERI Innsbruck. p. 20. (submitted)
• Paslaru Bontas Simperl, E., C. Tempich, and Y.
  Sure. ONTOCOM A Cost Estimation Model for
  Ontology Engineering. in The 5th International
  Semantic Web Conference (ISWC 2006). 2006.
  Athens, GA, USA Springer.
• Hepp, M., Possible Ontologies How Reality
  constrains Building Relevant Ontologies. Slides
  at the Logic and Information Workshop, Schloss
  Münchenwiler, November 23, 2006.

20
References (contd)

• myOntology Project, www.myontology.org
• Steinbock, D., et al., Collective Intelligence
  Quanitifed for Computer-Mediated Group Problem
  Solving, in Tech Report, U.o. California, Editor.
  2004, University of California Santa Cruz, CA,
  USA.
• Marjorie, E.S., A Comparison of Indidivudals and
  Small Groups in the Rational Solution of Complex
  Problems. American Journal of Psychology, 1932.
  44 p. 491-504.
• Lorge, I., et al., A survey of studies
  contrasting the quality of group performance and
  individual performance, 1920-1957. Psychological
  Bulletin American Psychological Assn. US, 1958.
  55 p. 337-372.
• Hill, G.W., Group versus individual performance
  Are N1 heads better than one? Psychological
  Bulletin American Psychological Assn. US, 1982.
  91(3) p. 307-321.
• Emigh, W. and S. Herring, Collaborative authoring
  on the web A genre analysis of online
  encyclopedias, in Hawai International Conference
  on System Sciences 2005 Hawai.
• Viegas, F., M. Wattenberg, and K. Dave, Studying
  Cooperation and Conflict between authors with
  history flow visualizations, in Proceedings of
  CHI'04. 2004, ACM Vienna, Austria.
• Stojanovic, L., A. Maedche, et al. (2002).
  User-driven Ontology Evolution Management. 13th
  European Conference on Knowledge Engineering and
  Knowledge Management EKAW, Madrid, Spain.
• Korpilahti, T. and E. Hyvönen (2004). An
  Architecture for Collaborative Ontology Library
  Development. ECAI 2004 Workshop on Application of
  Semantic Web Technologies to Web Communities,
  Valencia, Spain, CEUR Workshop Proceedings.
• Noy, N. F. and M. Klein (2004). "Ontology
  Evolution Not the Same as Schema Evolution."
  Knowledge and Information Systems 6(4) 428-440.
• Stumme, G. and A. Maedche (2001). Ontology
  Merging for Federated Ontologies on the Semantic
  Web. International Workshop for Foundations of
  Models for Information Integration (FMII2001),
  Viterbo, Italy.
• Kotis, K., G. A. Vouros, et al. (2006). "Towards
  Automatic Merging of Domain Ontologies The
  HCONE-merge approach." Journal of Web Semantics.
• Zhdanova, A. and P. Shvaiko (2006).
  Community-driven Ontology Matching. 3rd European
  Semantic Web Conference (ESWC2006), Budva,
  Montenegro.
• Lenat, D. B. and R. V. Guha (1990). Building
  Large Knowledge-based Systems Representation and
  Inference in the Cyc Project. Boston,
  Masschusetts, Addison-Wesley.
• Gruninger, M. and M. S. Fox (1995). Methodology
  for the design and evaluation of ontologies.
  Workshop on Basic Ontological Issues in Knowledge
  Sharing. Montreal, Canada.
• Gómez-Pérez, A., M. Fernández-López, et al.
  (2004). Ontological Engineering, Springer.
• Vrandecic, D., S. Pinto, et al. (2005). "The
  DILIGENT knowledge process." Journal of Knowledge
  Management 9(5) 85-96.
• Kerrigan, M. (2006). WSMOViz An Ontology
  Visualization Approach for WSMO. 10th
  International Conference on Information
  Visualization, London, England.
• Gómez-Pérez, A., M. Fernández-López, and O.
  Corcho, Ontological Engineering. 2004 Springer.

21
Thank you.

• PhD Seminar, Vienna
• Katharina Siorpaes
• September 2007