Parallel Syntactic Annotation of Multiple Languages

1
Parallel Syntactic Annotation of Multiple
Languages

• Owen Rambow, Bonnie Dorr, David Farwell, Rebecca
  Green, Nizar Habash, Stephen Helmreich, Eduard
  Hovy, Lori Levin, Keith J. Miller, Teruko
  Mitamura, Florence Reeder, Advaith Siddharthan

2
Interlingual Annotation of Multi-lingual Text
Corpora (IAMTC)

• CMU
• Lori Levin, Teruko Mitamura
• Columbia
• Owen Rambow, Advaith Siddharthan
• ISI
• Eduard Hovy
• MITRE
• Keith Miller, Flo Reeder
• New Mexico State University
• David Farwell, Steven Helmreich
• University of Maryland
• Bonnie Dorr, Rebecca Green, Nizar Habash

3
Goals of IAMTC

• Design an Interlingua
• Language-independent representation of text
  meaning
• Useful for MT, IR, IE, QA,
• Develop an Annotation Methodology
• Manuals, tools, evaluations
• Annotate multi-lingual, multi-parallel texts
• Foreign language original and 2 English
  translations
• Foreign languages Arabic, French, Hindi,
  Japanese, Korean, Spanish

4
IL Development Three Levels

• IL0 syntactic dependency tree
• IL1 semantic annotations
• Concepts
• senses from ISIs Omega ontology
• for Nouns, Verbs, Adjs, Advs
• Semantic Roles
• Theta Roles from Dorrs LCS work
• IL2 reconciliation of different IL1s with same
  meaning but different syntax
• Predicate argument structure
• Sentence plan main and embedded clauses

5
Outline

• Goals of IAMTC
• IL0 A deep syntactic dependency representation
• How and why it is different from other dependency
  representations
• Examples
• Copula
• Future tense
• Causative
• Light verbs
• Comparison to other work
• Prague tectogrammatical representation
• PropBank

6
Example of IL0
Sheikh Mohammed, who is also the Defense Minister
of the United Arab Emirates, announced at the
inauguration ceremony that we want to make Dubai
a new trading center
TrEd, Pajas, 1998
7
IL0 Design Reduce cross-linguistic Differences

• Retain content words
• Replace function words with syntactic features
• Tense, definiteness, etc.
• Retain information about the event and
  participants
• Neutralize information about the organization of
  the information or how it is communicated

8
IL0 Features

• Parts of Speech
• Verb, noun, proper noun, adjective, adverb,
  preposition, conjunction, determiner, aux
  (modal), punctuation, symbols, speech sounds,
  misc
• Features of Nouns
• Number, Definiteness
• Features of Verbs
• Progressive, Perfective, Tense, Mood

9
Summary of IL0

• No auxiliary verbs
• No determiners
• Add empty arguments
• I want ___ to go
• Undo passives and clefts
• Copular sentences are headed by the predicate
• The umbrella is red
• Retain causative markers and light verbs only if
  they affect the argument structure of the
  sentence or have a literal meaning
• Includes syntactic roles (Subj, Obj, IndObj, Mod)

10
Annotations done so far

• Annotations of 6 English Texts
• Each translated from a different source language
• Two translations of each text
• 10 12 annotators for each text
• Approximately 144 annotated texts total

11
IL0 Annotation Manuals

• English
• Arabic
• French
• Hindi
• Japanese
• Korean
• Spanish

12
Outline

• Goals of IAMTC
• IL0 A deep syntactic dependency representation
• How and why it is different from other dependency
  representations
• Examples
• Copula
• Future tense
• Causative
• Light verbs
• Comparison to other work
• Prague tectogrammatical representation
• PropBank

13
Copula

• English overt copula
• The umbrella was red.
• Arabic overt copula in past tense
• kAnat AlmiZlapu HamrAF
• Japanese optional copula (desu)
• Kasa wa akai.

14
IL0 for Copula Sentences
15
IL1 for Copula Sentence
16
Future Tense
English Juan will arrive
Spanish Llegará Juan
17
Causative Sentences in English, Japanese, and
Arabic

• English main clause and embedded clause
• I made the cat eat the fish
• Japanese productive causative morpheme
• Watashi-wa neko-ni sakana-wo tabe-sase-ta
• I TOP cat DAT fish
  ACC eat CAUSE-PAST
• Arabic lexical causatives
• gtakaltu AlqiTapa Alsamakpa
• Eat-CAUSE cat.DEF.ACC fish.DEF.ACC

18
IL0 for causative sentences in English, Japanese,
and Arabic
gtakalV,cause,past
SUBJ EmptyN
IOBJ catN,sg,def
OBJ fishN,sg,def
saseV,past
Reduce differences between languages but only to
the extent allowed by the syntax, morphology, and
lexical items
OBJ tabeV
SUBJ watashiN
OBJ sakanaN,sg,def
SUBJ nekoN,sg,def
19
Hindi Light Verbs
Hum santre kha gaye We oranges eat
went We ate oranges
20
Hindi Light Verbs
Ram santra kha-kar jayega Ram orange
eat-then go Ram will eat the orange and left
21
Outline

• Goals of IAMTC
• IL0 A deep syntactic dependency representation
• Examples
• Copula
• Future tense
• Causative
• Light verbs
• Comparison to other work
• Prague tectogrammatical representation
• PropBank

22
Comparison to other work

• Compared to annotation projects
• IAMTC is an interlingua project
• IAMTC annotates multi-lingual, multi-parallel
  texts in order to reconcile differences between
  languages
• Compared to interlingua design projects
• IAMTC is a corpus driven project
• IAMTC is an annotation project

23
Comparison to Tectogrammatical Representation

• IL0 has only syntactic relation labels
• In IL0 all adjuncts are marked adj
• IL0 retains strongly governed prepositions
• give X to Y
• IL0 prepositions are heads
• But there is some flexibility for each language
  to decide

24
Comparison to PropBank

• IAMTC is more syntactic
• Thematic paraphrases same arguments filling the
  same roles for the same verb
• Load hay on truck/load truck with hay
• Same in PropBank
• Different in IL0

25
End
26
Extra Slides
27
IL0 Differences Between Languages

• Morphological features on nodes different between
  languages
• No raising verbs in Arabic, Hindi, Japanese,
  Korean raising verbs have no subject
• John seems to like beans
• Serial verbs in Hindi additional verb with only
  aspectual meaning (?) treated as dependent on
  main verb
• hum santre kha gaye
• we oranges eat went
• We ate the oranges

28
IL0 Differences Between Languages (2)

• Morphological causatives in Japanese causative
  morpheme is head
• ?? (?? ?? ??-) -???
• 1sg-TOP (cat-DAT fish-OBJ eat-) -CAUSE-PAST
• I made the cat eat the fish
• Prepositions as heads in all our languages, but
  probably not others (Czech)

29
Summary What is Normalized Where?

• Syntactic variation IL0
• The gangster killed at least 3 innocent
  bystanders
• At least 3 innocent bystanders were killed by the
  gangster
• Lexical synonymy IL1
• The toddler sobbed, and he attempted to console
  her
• The baby wailed, and he tried to comfort her
• Diathesis alternation IL1 (caveat)
• The men loaded hay into the trucks
• The men loaded the trucks with hey

30
Summary What is Normalized Where?

• Part-of-speech class and derivational morpholgy
  IL1/2
• I was surprised that he destroyed the old house
• I was surprised by his destruction of the old
  house
• Possession IL1
• Dubaiss oil, oil of Dubai
• Clause combination IL2
• This is Joes new car, which he bought in New
  York
• This is Joes new car. He bought it in New York

31
Summary What is Normalized Where?

• Different argument realizations IL1/2
• Bob enjoys playing with his kids
• Playing with his kids pleases Bob
• Noun-noun compounds IL2
• She loves velvet dresses
• She loves dresses made of velvet
• Head switching IL2
• Mike Mussina excels at pitching
• Mike Mussina pitches well
• Mike Mussina is a good pitcher

32
Summary What is Normalized Where?

• Overlapping meaningsIL2
• Lindbergh flew across the Atlantic Ocean
• Lindbergh crossed the Atlantic Ocean by plane
• Locus of Negation IL2
• I have not bought any cheese
• I have bought no cheese 

33
Summary What is Normalized Where?

• Light verbs IL2
• conduct a tightening tighten
• witness a growth rate of grow by
• Direct and indirect discourse IL2
• said X vs. said that X

34
Not Normalized at IL0, IL1, nor IL2

• Logical inferences
• Hes smarter than everybody else
• Hes the smartest one
• Real-World Inference
• The tight end caught the ball in the end zone
• The tight end scored a touchdown
• Different syntactic sentence types, same
  pragmatic meaning
• Who composed the Brandenburg Concertos?
• Tell me who composed the Brandenburg Concertos

35
Not Normalized at IL0, IL1, nor IL2

• Viewpoint variation
• The U.S.-led invasion/liberation/occupation of
  Iraq
• He is getting in the way vs.
• He is only trying to help

36
Differences from other projects

• Eurotra, Euro WordNet, UNL
• Share the goal of defining an interlingua
• Dont share the goal of producing an annotated
  corpus
• ParGram
• Grammars for several languages developed in close
  consultation
• Based on the assumption of universal grammar
• Not an annotation project
• Not corpus based

37
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

38
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

black same words, same meaning
39
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

green small syntactic differences
40
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

blue lexical differences
41
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

red not contained in other text
42
Getting at Meaning(Two translations of Korean
original text)

• Starting January 1st
• of next year
• customers of SK Telecom
• can change their service company to
• LG Telecom or KTF
• Once a service company swap has been made,
• customers
• are not allowed to change
• companies again
• within the first three months,
• although they can cancel
• the change
• anytime within 14 days
• if problems
• such as poor call quality
• are experienced.

• Starting on January 1
• of next year,
• SK Telecom subscribers
• can switch to
• less expensive LG Telecom or KTF.
• The Subscribers
• cannot switch again
• to another provider
• for the first 3 months,
• but they can cancel
• the switch
• in 14 days
• if they are not satisfied with services
• like voice quality.

purple more complex relations